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ABSTRACT 



The Online Books Evaluation Project at Columbia University 
(New York) explores the potential for online books to become significant 
resources in academic libraries. The Project confronts and explores a set of 
feasibility issues, including publishers’ ability to provide books of various 
types and vintages in forms conducive to conversion to online formats and the 
ability to convert them to online books that will serve users' needs and 
preferences. This paper focuses on the first of the Project's elements, user 
response, and reports on: (1) the conceptual framework of the Project; (2) 

background information on the status of the collection and other relevant 
Project elements, particularly design considerations; (3) methodology for 
measuring adoption of online books by the Columbia community; (4) current 
findings on relevant environmental factors, including access to online 
resources; (5) current findings on use of online books and other online 
resources; and (6) current findings on attitudes toward online books. This 
paper also reflects the experiences of the Project as a case study, 
specifically, the problems encountered evaluating online resources and 
problems encountered in producing online books. Fifty-nine tables present 
statistics. (Contains 47 references.) (AEF) 
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The Online Books Evaluation Project at Columbia University explores the potential for online 
books to become significant resources in academic libraries by analyzing (1) the Columbia 
community's adoption of and reaction to various online books and delivery system features 
provided by the Libraries over the period of the Project; (2) the relative life cycle costs of 
producing, owning and using online books and their print counterparts; and (3) the implications 
of intellectual property regulations and traditions of scholarly communications and publishing 
for the online format. 

Online books might enhance the scholarly processes of research, dissemination of findings, 
teaching, and learning. Alternatively, or in addition, they might enable publishers, libraries and 
scholars to reduce the costs of disseminating and using scholarship. For example: 

• If the scholarly community were prepared to use some or all categories of books for some 
or all purposes in an online format instead of a print format, publishers, libraries and 
bookstores might be able to trim costs as well as enhance access to these books. 

• If online books made scholars significantly more efficient or effective in their work of 
research, teaching and learning so as to enhance revenues or reduce operating costs for 
institutions of scholarship, these books might be worth adopting even if their costs were 
no lower than those for their print counterparts. 

• If an online format became standard, publishers might be able to offer affordable online 
access to books to institutions which would not normally have purchased print copies, 
thus both expanding convenient access to scholarship to members of those institutions 
and expanding publishers' revenues from these books. 

The Columbia Online Books Evaluation Project is designed to learn about the scholarly 
community's enthusiasm for the online format in the near term and about features that users will 
demand, to project likely adoption patterns, and to estimate gains in operating effectiveness, 
revenue, and cost, if any, to be realized by publishers, funders of scholarship, libraries, and 
scholars. The Project confronts and explores a set of feasibility issues, including publishers' 
ability to provide books of various types and vintages in forms conducive to conversion to 
online formats and our ability to convert them to online books that will serve users' needs and 
preferences. 

This paper focuses on the first of the Project's elements, user response, and reports on: 

1. the conceptual framework for the Project; (Section 2) 

2. background information on the status of the collection and other relevant Project 
elements; particularly design considerations; (Section 3) 

3. our methodology for measuring adoption of online books by the Columbia community; 
(Section 4.1) 

4. our current findings on relevant environmental factors, including access to online 
resources; (Section 4.2) 

5. our current findings on use of online books and other online resources; (Section 4.3, 5.2) 



ERJC 

hiMfflifliffiMiiiaa 

2 oi o 



10 



12/1/97 1:07 PM 



AKL’s Scholarly Communication and Technology Project 



http ://www .arl . org/scomm/scat/summertield 1 .html 



6. our current findings on attitudes toward online books. (Sections 6 and 7) 

The paper also reflects on our experience as a case study, specifically (1) problems encountered 
evaluating online resources (Section 6), and (2) problems encountered in producing online 
books (Section 3.2). The Project began in early 1995 with three reference works online; in 
autumn 1996 the first modem monographs became available to the Columbia University 
community which is the focus of the study. 

Our current findings may be summarized as follows: 

• Most if not all reference books are used more heavily online than in print. (Section 
4.3.1) 

• Early online reference books have experienced falling usage over time, substitution of 
use of a new delivery system for an old one, or a smaller rate of growth of use than 
might be expected given the explosion in access to and use of online resources in 
general. (Section 4.3.1) 

In the early to mid-1990s, the novelty of online books may have brought users to the format 
somewhat without concern for their design, the utility of the delivery system, or the qualities of 
the books. With enhancement in delivery systems and expansion in the number of online books, 
being online is no longer a guarantee that a book will be used. New graphical delivery systems 
offer superior performance that is likely to draw scholars away from these early online resources 
provided via text-based systems increasingly, as access to those new delivery systems spreads. 

In addition, as more competing resources come online and either provide information that 
serves the immediate needs of a user better or offers a more attractive, user friendly format, 
scholars are less likely to find or to choose to use any single resource. 

• Online scholarly monographs are available to and used by more people than their print 
counterparts in the library collection. (Section 4.3.2) Once a print book is in circulation, 
it is effectively unavailable to others for hours in the Reserve collection and weeks or 
months in the regular collection. An online book is always available to any potential user 
who has access to a computer with a Web browser. 

• Being online may bring to a book scholars who would not have seen it otherwise. 

(Section 4.3.2) However, it is not yet clear whether their productivity or work quality will 
be significantly enhanced by such serendipity. The important concept of collation is 
transformed, in the networked environment, to a diversity of finding and navigational 
systems. As the online collection grows, browsing will require the focused use of online 
search tools rather than use of project-oriented Web pages. 

• Data from the most recent 11 weeks, including the last half of the spring 1997 semester, 
suggest that when a social work book available in both print and online formats was 
used in a course, the share of students using the online version was at most one-quarter. 
(Section 4.3.4) We will track this rate of penetration for social work and other disciplines 
over the next semesters to see if students increase their rate of adoption. 

• Some scholars, especially students in a course assigned a reading that is in the online 
collection, are looking at the online books in some depth, suggesting that they find value 
in this means of access. (Section 4.3.4) For example, in the most recent 11 weeks 
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analyzed, the two most frequently used monographs averaged 9.6 and 7.7 hits (chapters) 
per unique user. 

• Scholars residing off-campus are not using the online books from their homes to a 
significant degree. (Section 4.3. 2.2) For the ten months from May 1996, only 11 percent 
of the hits on Columbia University Press monographs were dial-up connections. Scholars 
report (in our interviews) that the expense of dialing-in to campus or maintaining an 
Internet account, the lack of sufficiently powerful home computers and Web software, 
and the slowness of delivery of the Web over standard modems are key constraining 
factors. 

• Students residing on campus may have Ethernet connections to the campus network - 
providing both speedy and virtually free access to the online collection. They are using 
online books, especially reference works, from their dorms during hours when the 
libraries are not open. Forty-two percent of the hits on The Oxford English Dictionary in 
the ten months from May 1996 were from computers with such residence hall 
connections. (Section 4.3. 1.2) 

• Some scholars perceive gains in the productivity and quality of their work in using 
online books, particularly reference books. Over half the respondents to our online 
survey (a small number ) see the productivity and quality of their work using online 
resources to be as good or better than that achieved using paper resources. (Section 
6 . 2 . 11 ) 

• In surveys and interviews, students report that they particularly value easy access to the 
texts that are assigned for class and an ability to underline and annotate those texts. 
Students seek the ability to print out all or parts of the online texts that they are using for 
their courses, again indicating their desire to have the paper copy to use in their 
studying. Computer access to a needed text is not equivalent to having a paper copy 
(whole book or assigned portion) in one's backpack, available at any time and at any 
place. (Section 5.2.4) 

If the effective choice is between borrowing a book from the library, probably on a very short 
term basis from Reserves, and accessing the book online, the student is facing a parallel 
situation of needing to photocopy or print out to obtain portable, annotatable media. However, 
the online book has the advantages of never being checked out when one wants to use it and of 
being accessible from a computer anywhere in the world at any time (as long as that computer 
has an Internet connection and a browser). 

• In surveys and interviews we find that scholars value the ability to do searches, to 
browse, and to look up information in an online book quickly. They also like the ability 
to clip bits of the text and put them in an electronic research notes file. Willingness to 
browse and to read online for extended periods varies from person to person, but it does 
not seem to be widespread at this time. 

• Scholars with easy access to a networked computer spend more time online and are more 
likely to prefer to use one of the forms of the online book. (Section 7) This suggests that, 
over time as such access achieves greater penetration in the scholarly community, online 
books will be achieve greater acceptance. 
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• In the most recent 11 weeks studied, 52 percent of the online book users who viewed our 
online survey responded to it, but only 15 percent of these users chose to click on the 
button taking them to the survey. (Section 6.2.14) Designing an online survey that is 
available to the reader without his taking action might enhance the response rate 
significantly. 



2. CONCEPTUAL FRAMEWORK 

The variables representing usage of a system of scholarly communication and research are at the 
same time effects and causes. Since scholars, the users of the system, are highly intelligent and 
adaptive, the effect of the system will influence their behavior, establishing a kind of feedback 
loop. As the diagram in Figure 1 shows, there are two key loops. The upper one, shown by the 
dark arrows, reflects an idealized picture of university administration. In this picture, the 
features of any system are adjusted so that, when used by faculty and students, they improve 
institutional effectiveness. This occurs in the context of continual adaptation on the part of the 
users of the system, as shown by the lighter colored arrows in the lower feedback loop. 

All of this is constrained by the continual change of the environment, which affects the 
expectations and activities of the users, affects the kind of features that can be built into the 
system, and affects the very management that is bringing the system into existence. This 
interaction is shown by the dotted arrows in Figure 1 . 

Figure 1. Interrelation of Factors Involved in the Use and Impact of Online Books. 



Interrelationship of Key 
Variables or Factors 




f System Features ) — User Activities ) 



User Attitudes ) 



Our primary research goal, in relation to users, uses, and impacts, is to understand these 
relationships, using data gathered by library circulation systems, Internet servers, and surveys 
and interviews of users themselves. 
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The Online Books Evaluation Project began formal activity in January 1995. However, 
discussions with publishers about cooperating in such an effort by providing books and 
collaborating in research began in 1993, if not earlier. As noted in the Project's Analytical 
Principles and Design document, "The Online Books Evaluation Project is a component of the 
developing digital library at Columbia University. As part of its digital library effort, the 
Columbia University Libraries is acquiring a variety of reference and monographic books in 
electronic format to be included on the campus network; in most cases, those books will be 
available only to members of the Columbia community. Some of the books are being purchased; 
others are being provided on a pilot project basis by publishers who are seeking to understand 
how the academic community will use online books if they become more widely available in the 
future. " 

Columbia University Libraries provides the Columbia community with access to a substantial 
and growing set of full text (journals and reference materials), image, data and bibliographic 
online resources in addition to those that we are studying in the Online Books Evaluation 
Project. Some have been acquired or developed at Columbia and are maintained on servers here, 
e.g., art images, working papers. Others are maintained by publishers with access licensed to 
Columbia, e.g., Encyclopedia Britannica and Gale's Contemporary Authors and Encyclopedia 
of Associations. Yet others are maintained elsewhere and access is free to all, with Columbia 
subject specialists providing links on their subject home pages. 



3.1 Design Of the Online Books Collection 

When this Project was proposed, the World Wide Web was an emerging technology, and we 
still expected to develop specialized browsers for using the books in SGML format, just as other 
online projects were doing at the time. However, by the time the Project was funded and ready 
to mount books online, it was clear that the Web would soon be the best delivery system for 
maximizing availability of the books to the scholarly community. Web browsers had, and still 
have, annoying limitations, but we felt that they would become better over time and provide 
optimum flexibility to users. 

Many other online projects are providing users with materials in PDF, scanned, or bitmapped 
format. These are effective formats for journal articles, which are finely indexed through existing 
sources and which are short and easily printed. However, the greatest potential added value 
from online books, compared to their print counterparts, comes with truly digital books. Only in 
this type of format, for example, can users do full search for terms or cut and paste parts of the 
book to another document. In addition, only this online format allows the development of truly 
interactive books that take advantage of the current and anticipated capabilities of Web 
technology, such as the inclusion of sound and video, data files and software for manipulating 
data, and links to other online resources. Perhaps only such enhanced online books will offer 
sufficient advantages over traditional print format that scholars will be willing to substitute them 
for the print format for any or all of their modes of use and for any or all classes of books. 

We have devoted considerable time and effort over the past two years to dealing with technical 
and design issues for the books. The design has evolved over this period as Web technology has 
advanced and as the Project team and users have reacted to early decisions. We will continue to 
work with users over the months ahead in order to provide basic design features that they 
endorse. We hope to begin to introduce more interactive features as appropriate to various 
books and to measure user response to them. 
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We look forward to comparing the results of our evaluations with those of online projects using 
other formats to explore whether format does make a significant difference in user attitudes and 
behavior. 



3.2 Development of the Online Books Collection 
3.2.1 Purchased Texts 

Purchased texts included in the Online Books collection are The Oxford English Dictionary and 
classical texts in social thought from InteLex's Past Masters CD-ROM. Columbia converted the 
Past Masters texts from SGML to HTML for Web access. Ten Past Masters texts were made 
available to the Columbia community online in mid- 1995, although with little publicity. Another 
44 went online in July 1996, with publicity for the collection beginning early in the Fall. We 
intend to convert several other purchased CD-ROM products, largely literary texts, and include 
them in the collection in the near future. The Columbia digital library provides access to many 
other full text works to the scholarly community, but the ones described here have been the 
focus of our analysis, in large part because they are mounted on local servers from which 
detailed usage information can be gathered. 



3.2.2 Collaborating Publishers And Their Books 

Publishers participating in the Project by providing electronic files for their books and 
collaborating in the research effort are Columbia University Press, Garland Publishing, Oxford 
University Press, and Simon and Schuster Higher Education. All but Garland have been 
involved in this Project since its inception; Garland jointed the effort in 1996. The books 
provided by each pubhsher and the timing of the introduction of those books to the online 
collection are as follows: 

Columbia University Press: Two reference works, The Columbia Granger's Index to Poetry 
and The Concise Columbia Electronic Encyclopedia, have been available since the outset. 
Columbia will provide three more reference books - The Columbia Electronic Encyclopedia, 
The Columbia Guide to Standard American Usage, and The Columbia World of Quotations - 
in 1997. Monographs, anthologies and textbooks are being provided in the fields of social work, 
literary criticism, political science, and earth and environmental science. The Project includes 
only books for which the Press can obtain both electronic files and author permissions. Sixteen 
such books are now in the collection, seven of them in the field of social work. The first of these 
books were made available online in September 1996. At this point, it appears that 27 more 
CUP books published in these fields in the past three years will be available to our collection; 
they will be added in the next few months. 
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Garland Publishing: Three Garland reference works, The Chaucer Name Dictionary, Native 
American Women: A Biographical Dictionary, and African American Women: A Biographical 
Dictionary, were added to the collection from December 1996 through February 1997. We 
selected these books because Columbia has sizable user groups in Medieval and Women's 
Studies and because they were available in electronic format and amenable to conversion to 
HTML. Garland is reviewing its collection and its resource availability to determine whether it 
can provide any other books to the Project. 
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Oxford University Press: In 1995, Oxford agreed to provide its monographs in the fields of 
literary criticism, neuroscience, and philosophy from the publication lists for 1995 through 1997. 
Oxford reports that a substantial share of titles in these fields have low sales and, hence, 
represent the endangered scholarly monograph. As of early 1996, Oxford had provided 
electronic files for 19 monographs in the fields of literary criticism and philosophy. Oxford 
required the Project to provide an online ordering mechanism concurrent with the availability of 
its books; that ordering system was ready for use in October. Sixteen Oxford books were online 
by year end 1996; 17 are now online. In June 1997, Oxford provided nine more books in literary 
criticism and philosophy. These should be online by fall 1997. 

Simon and Schuster Higher Education: By late 1994, Simon and Schuster had agreed to 
contribute high use titles, defined as books on reserve for Columbia courses that had relatively 
heavy circulation. Simon and Schuster provided electronic files for nine such books, most of 
them in business-related subjects, in Fall 1995. As of June 1997, two of the books were online 
and the others were expected to be ready before the new academic year. 



3.2.3 The Challenge of Obtaining Electronic Files for Books from Publishers 

The Project's 1997 Annual Report discusses publishers' difficulty in providing electronic files for 
books that are amenable to conversion to the HTML format being used in the Project. Those 
problems include: 

• Neither the publishers nor their printers have ready access to the final electronic files, e.g., 
typesetter's tapes, for books unless specific provision has been made for systematic 
retention and archiving of such files. Most publishers have not been able routinely to 
provide the Project with copies of the electronic files for books published since the early 
to mid-1990s. 

• The electronic files for some books contain so many special characters and graphics that 
conversion to HTML format is infeasible. 

• Publishers never possessed electronic files for books that authors supplied as 
camera-ready copy. 

• After publication, seeking permissions from multiple copyright owners involved in a 
book, such as a collection of essays, would be too onerous. 

• Interviews with authors reveal that those who refuse to include their books in the Project 
do so for various reasons. Some fear the ease of downloading and printing Web materials 
will tempt users not to respect copyright and that scholars outside of the Columbia 
community will receive copies of their works, thus reducing their royalty income. Others 
oppose the concept of online books and do not want to encourage them. 

3.3 User Access to the Collection 

3.3.1 Formats and Functionalities Over Time 



ERIC 




4 oio 



12/1/97 1:09 PM 



AKL’s Scholarly Communication and Technology Project 



http://www.arl.org/scomm/scat/summertield2.html 



As of June 1997, the Columbia community had access to a total of 96 online texts that are part 
of the Online Books Project. The Libraries have each book in print form, circulating from the 
regular collection or Reserves, or non-circulating in Reference, as well as in one or more online 
formats. Appendix 1 summarizes the print access modes for all the modern books in the 
collection. The various online modes have differing functionalities beyond browsing or reading 
on screen. Appendix 2 summarizes the schedule of mounting for the online books and their 
functionalities. 



3.3.2 Who Can Use The Collection 

By agreement with the publishers, we restrict access to the Project's online books to members of 
the Columbia University community, i.e., faculty, staff and students of Columbia and affiliated 
institutions who use the books in the Libraries and from anywhere via network access. Until 
March 1997, books were also available, only on Libraries terminals, to alumni and others with 
reading privileges. This policy both protects the publishers' intellectual property and provides 
the Project with the ability to gather richer data on usage. 

Through Winter 1997: We employed two methods through Winter 1997 to maintain this 
control of access. 

• To use books on CNet or at the Unix prompt, a scholar must sign in with her Columbia 
email address and password. This remains the case for this set of books. The exception to 
this rule is the public CNet terminals. 

• To access books on CWeb, a scholar was required to use a computer with an address that 
the server recognizes as Columbia affiliated. Members of the Columbia community who 
connected to CWeb from a service like AOL were not able to use the collection. On the 
other hand, guests using X-terminals on the Columbia campus could reach those books. 

In both cases, the data the server logs did not include information on the user. We initially 
planned to develop a directory of Columbia IP addresses by location and to link it to the server 
data in order to make general discrimination between dormitories and various other campus 
buildings. However, we decided that developing and maintaining this database would be too 
costly, given our near term plans for individual user authentication. Instead our analyses for the 
period before mid-March 1997 result from deduction based on the host name of the user 
computer. 

As of March 15, 1997: For books in this Project and other materials with user restrictions, 
Columbia has developed and deployed a more robust system for Web authentication and access. 
This system permits a member of the Columbia community to use materials even if she connects 
through an Internet service provider like AOL. It requires each user to sign in when he wants to 
use one or more items in the collection. During a session, he needs to sign in only once. 
Ultimately, data records will be session based, that is Unking all the activities by a user in a 
single session within its umbreUa into a single record and providing information on the identity 
of that user. 

Future: Given that Web browser/server interaction are stateless, i.e., each transaction is 
essentially independent of previous ones and the server retains no memory of a user's previous 
actions, translating the abihty to control access to resources to the Web has been a chaUenge. 

O 

ERLC 

5 oi s Jl U 



12/1/97 1:09 PM 



AKL’s Scholarly Communication and Technology Project 



http://www.arl.org/scomm/scat/summeitieldZ.html 



This local authorization system manages access with information from the central authentication 
database. This session-based system supports more extensive analysis of usage patterns. In 
particular, usage statistics can be tied to user characteristics. The management statistics system 
that will link access to a book with information on the user's affiliations and status should be 
fully ready this summer. In particular, transaction statistics may be aggregated for individuals, 
based on their initial 'login', providing more continuous, 'session based' tracking. To protect 
privacy, the personal key will be retained long enough to look up the required demographic 
information and will then be retained in encrypted form, to serve as an anonymous unique 
identification code. 



3.3.3 Access Paths to CWeb Books 

Users have six main alternatives for learning of the CWeb books: (1) word of mouth; : (2) the 
online catalog; (3) the Libraries' Digital Collections Web page; (4) the Project's home page; (5) 
Web pages for specialized library collections; and (6) publicity flyers, email messages, and 
formal and informal presentations by librarians and Project staff directed at the faculty and 
students most likely to be interested in the various online book collections. 

In CLIO, the online catalog, a record for each online book lists its Web address (URL). In the 
near future when CLIO moves to the Web, a scholar will be able to click on that URL in the 
CLIO record and proceed directly to the book. During the period covered by this report, 
however, in order to move from that CLIO record to the online book, the scholar must either 
copy or write out the URL, switch to the Web, and input the URL into the Location box. 

The first CWeb access point for the monographic (non-reference) books is a set of links to the 
Web pages with the subject categories into which we have grouped the books and another link 
to an alphabetical listing by author of all the texts in the collection. These links are on the 
Libraries' Digital Collections home page at htt p://www.eohimlMa.edu/cu/libraries/digital/ . (See 
Exhibit 1.) 



Exhibit 1. Columbia University Digital Library Collections 

http://wvv.columbia.edu/cu/libraries/digital/ 

A scholar starting at the Columbia University Web home page must take two steps to reach that 
list (to Libraries, to Digital Collections). 

During Fall 1996 and Winter 1997, we sought ways to focus user attention on the collection, in 
the hopes of achieving more use and feedback. At the end of 1996, we launched a new Project 
home page thtip://www. columbia.edu/dlc7olb/ '): see Exhibit 2. This page has a brief description 
of the evaluation effort, a link to the page that includes copies of the Project documents, a 
button for comments about the design of the online books system, a button for sending email to 
the Project Coordinator, and a capability to search by keyword throughout the books in the 
collection. In addition, it has links to groups of books in the collection: Historical Social 
Thought, Current Humanities, Current Social Science, Current Science, and Current 
Reference. We have included books in more than one of those groupings as appropriate; for 
example, each Garland reference book is in Current Reference and another subject category. 

Once the scholar moves to one of the topical collection pages, he sees the books arrayed by 
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primary subject category; pictures of the books’ dust jackets accompany some of the titles. 
(Exhibit 3 has part of the Current Social Science page; 

http://www.columbia.edu/cu/libraries/digital/texts/social sciences. html .) He has two options at 
this point: (1) clicking on one of those titles and going directly to the Table of Contents for that 
books or (2) doing a keyword search on that whole topical collection. 

Besides these core locations, the online books on CWeb are typically linked to several pages 
where potential users might find them. Most of these are subject listings that collection 
bibliographers maintain, e.g., Online Books on the Social Work Library home page links to the 
Current Social Science page, or the Medieval Studies home page listing of Internet resources 
links to The Chaucer Name Dictionary. 

A scholar wishing use one of the online collections repeatedly could bookmark the relevant 
subject matter page. He would then need only to select that bookmark from within his browser 
in order to reach that page. 

The five Web reference books in the Online Books collection are also included in a separate set 
of pages maintained by the Reference Department. The scholar must traverse several levels 
before reaching any of the resources using this route. Finally, some of these resources are linked 
to Web pages created by various other Columbia groups. 

Exhibit 2. Online Books Evaluation Project: Titles Included - Home Page 

h t t p : / /ww w,coliimliia,ed.u/.dic/Qlb/ 

Exhibit 3. Online Books Evaluation Project: Titles Included - Current Social Sciences 

http://www.columhia.edu/cu/librar-ies/digital/texts/social sciences.html 



3.3.4 Publicity Campaign 



Our publicity campaign for the online books collection has had several facets. The key 
component is a set of flyers, each focusing on one category of books. These flyers have major 
headlines followed by a listing of the online books available in that category, a brief explanation 
of the Online Books Evaluation Project, and then directions on how to reach and use the 
collection. These flyers have been sent to all the faculty members in each of the related 
departments and to graduate students whom we have identified as teaching in those 
departments. In some cases in which faculty members are using one of the titles in a course, we 
have provided copies of the flyer to each student. In some cases, we have gone to those classes 
to discuss the Project and how to use the books. We have also made presentations to faculty 
groups about the Project. More such presentations will be made in future semesters. 
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At this point, we are seeking a viable balance in our publicity. Over-promoting a collection that 
contains only a few books may create disgruntled potential users who are likely to be skeptical 
about the collection in the future. On the other hand, publicity is needed in order to create the 
awareness and sampling that are necessary precedents to regular use of online materials. 
Marketing research shows that publicity is most successful in cases in which a target group is 
generally seeking the product being offered. In our case that is scholars are likely to focus on 
publicity when they need to use one or more of the available books, e.g., Social Work students 
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who are using one of the titles in a course or undergraduate students who have been told to use 
The OED for an assignment. 
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4.1 Methodology For Studying Use of And Reactions to Various Formats 

We laid out the evaluation methodology for this Project in our Analytical Principles and 
Design. This methodology, formulated in the first year of the Project, remains the working plan. 



4.1.1 Measurement Plans 

Analytical Principles and Design sets forth our plans in this area as follows: 

Success of online books is in large part measured by the rate of adoption by the scholarly 
community and the extent to which they appear to be replacing print books in use. Data on the 
use of online books and circulation of print books are also available which will allow us to 
draw certain conclusions on how the various formats are being used. 

A related component of our plan is to study the socio-technical environment in which the 
Columbia community functions and adoption of other forms of electronic communication and 
scholarly research under the hypothesis that the more Columbia scholars are familiar and 
comfortable with computing and electronic resources the more likely they are to adopt online 
books. We summarize some of the early data on this socio-technical environment below. 
(Section 7 discusses this analysis further.) 



4.1.2 Documentation Measures for Use of Online Books 



Some of the key measures for documenting use of the online books are: 
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• The records of the Columbia computing system provide, for the most part, the use data 
for the online books. For books accessed via the World Wide Web, information on date, 
time and duration of session involving an online book, user's cohort, location of 
computer, number of requests and amount of the book requested, means of accessing the 
book, and networked printing activity will be available. These data will become available 
in summer 1997 with the full implementation of the authentication system and related 
databases. 



• Circulation data for each print book in the regular collection provides information on 
number of times a book circulates, circulation by cohort, duration of circulation, number 
of holds and recalls. For most libraries, the data available for reserve books is the same as 
that for books in the regular collection as the CLIO circulation system is used for both. 



• The records of the Columbia computing system provide, for the most part, the use data 
for the books accessed via CNet, Columbia's original, gopher-based Campus Wide 
Information System, including the number of sessions and hits, their date and time. These 
records do not include the duration of the session, the activity during the session, e.g., 
printing or saving, or anything about the user. Thus, all we can analyze are the patterns of 
use by time of day, day of week, and over time. 



Until March 15, 1997, for books accessed via CWeb, we knew the use immediately 
preceding the hit on the book, the day and time of the hit. For data collected through that 
point, our analysis is constrained to patterns of use bv time of dav, day of the week, and 
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over time. By manual examinations of server data, we counted how many hits a user 
made on our collection during one session and the nature of those hits. 

• Since March 15, 1997, we are able to link user information to usage information and 
derive a series of analyses involving titles used, number of hits, number of books used, 
and the like by individual and to group those individuals by department, position, and age. 
These data do not yet include number of sessions of use, just the magnitude of overall use 
during the period. Session specific data will be available by fall 1997. 



4.1.3 Documentation Measures for Reactions to Online Books 

We are using a wide range of tools in trying to understand the factors that influence use of 
online books. 

Table 1 summarizes our complex array of surveys and interviews. 



"able 1 . Types of Surveys 



[Population 


Method 


Contact 


[Rate [Remarks 


[Users of Online 
[Books 


Online 

instrument 


Passive 


| 

Low 


[Users of Online 
[Books 


Online post-use 
urvey 


Passive 


jVery Low 


[Users of paper 
[alternatives 


Response slips in 
books 


Passive 


L , [Levels of use 

Unknown . 

\ [not known 


[Users of course [ 
[materials in 
[either form 


nterviews 
distributed in 
class 


Active 


[High 


L . 

[Users and 
[non-users 


Library & 

Campus-Wide 

surveys 


Active 


| [No full active 

< :[ 

L. , ^ [survey of the 

Moderate . , 

| [campus has been 

| [done 


[Discipline-specific 
[potential users 


Surveys & 
nterviews 


Active 


J [Thus far only 

L. , [[conducted 

| ® [before books 

| [were online 



Mote: Passive instruments are ones which the user must elect to encounter. 
Active instruments are distributed in some way, to the attention of the user. 
High response rates are in the range of 80-90 percent completion, with better 
60 percent usable. 



4.2 Socio-Technical Environment 



3 



o 



ERJC 

!£1ZEZ!Z£Q3 
01 IS 



In our analytical construct, we posit that three sets of socio-technical environmental factors and 
their change over time will influence the adoption of online books by the Columbia community. 
These are external (U.S.), disciplinary, and Columbia-related factors. The first and the third of 
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these are discussed below. 



4.2.1 External Socio-Technical Environment 

In tracking the external socio-technical environment that might affect adoption of online books 
by members of the Columbia community, we look at three primary measures: 

1. Attention to the Internet and related issues in the press, measured by New York Times 
articles; 

2. Trends for prices and technical specifications for personal computers, measured both by 
looking at recommendations for minimum computer standards offered by various writers 
and at the offerings of Gateway 2000; and 

3. Penetration of computers, modems, Internet access into American homes as reported by 
various market research companies. 

Our findings to date are summarized below. 



4.2.1. 1 Media Coverage Of the Internet 

We hypothesize that members of the Columbia community are more likely to feel that 
up-to-date personal computer systems and online resources are important to their lives and 
scholarly work the more the media that they see report on them. The New York Times is our 
media proxy in tracking the number of stories that community members might have seen 
involving online-related topics over the past three years. 



[Table 2. New York Times Stories Involving Information Services 



i : i 


E 




| ' ~1j 




Pet 


Pet ii 


| Descriptor Term 


1994 1 


1995 j| 


1996 


1994 - 1996 


Chg. 


Chg. | 


\ ii 


1 ii 

\ 1! 






i| 


’94-95 


195- 96 [j 


! Internet 


166 ii 


1315 i| 


|360 Ii 


[741 j 


1377% [j 


14% 


| Online Information 
| Services 


ii 

jo 


1.61 i| 

1 il 


140 


301 


NA : 


-13% ;| 


| World Wide Web 


|o~j! 


112 ! 


1106 


[218 


NA 


1-5% | 


| Information 
1 Superhighway 


27 

i ii 


12 i| 

1 il 


5 


44 


[ 1 

-56% : 


-58% j 


[Electronic Publishing 


30 


29 i| 


|24 


83 


1-3% i| 


1-17% | 


J | j 

[Computer Networks 


187 


129 il 


146 


1362 


-31% ii 

c ■< 


-64% | 



|Source: Periodical Abstracts, using so=New York Times, de=Descriptor Term 
[here, and period=Year given here. 



Discussions of the Internet soared from 1994 to 1995 and then stayed at a relatively even level 
of about one story a day. Online Information Services and World Wide Web went from not 
even being descriptor terms in Periodical Abstracts for 1994 to coverage at about half the rate 
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oi tne internet in general in tne next two years, inese terms seem to nave suppiantea computer 
Networks which was a significant term in 1994. 



4.2.1.2 Personal Computer Specifications & Pricing Trends 

Since the development of personal computers we have seen a continual growth in the quality of 
the systems on offer and a flat or declining price for the systems recommended for household 
purchase. In 1997 for the first time, manufacturers have introduced systems priced at around 
$1,000 that will allow a household to access the Internet smoothly if not with the speed and 
monitor performance of a system costing twice that much. In June 1997, Gateway 2000 was 
offering a family-oriented system for $1,499 that was significantly more powerful in almost 
every parameter than a system priced at $1,999 in May 1996. 

Appendix 3 tracks the minimum recommended specifications for home computers given by 
various writers from May 1994 to April 1997. Summarizing these data by looking at three major 
factors (CPU, RAM, and hard drive capacity)), we see dramatic increases over the past three 
years. In the earlier years, neither Pentium CPUs nor personal computer hard drives with 
capacity above 340 MB were even available. 

Table 3. Minimum Recommended Specifications for Home Computers, May 1994 - April 

1997 



| May 1994 
! (for student) 


| April 1995 


April 1996 


April 1997 | 


Icpu 

\ 


486 

\ 


| 486DX2/66 


75 Mhz 
Pentium 


166 Mhz MMX i 

f 

Pentium 1 


|ram 


4 MB 


8 MB 


8 MB 


16 MB j 


jHard Drive 


100 MB 


1 340 MB j 


1 GB 


2 GB 


| Price Est. 


$1,500 


! $1,800- j 
| $2,000 ! 


$2,000 


Not given in thej 
source j 



jNote: This is an extract from Appendix 3. 



As one might expect given Gateway 2000’s leading position in the family personal computer 
market, its offerings track these recommendations by journalists. As Appendix 4 shows, the 
personal computer capability available for about $2,000 has escalated since late 1994, our first 
data point. All of these computers are equipped with CD-ROMs, sound systems, and modems. 
Summarizing that appendix, we find that a $1,500 computer today is over twice as large and 
twice as fast as a $2,100 computer thirty months ago. 

Table 4. Characteristics of a $2,000 Computer, December 1994 - June 1997 



O 

ERIC 



5 oiio 






12/1/97 1:09 PM 



AKJL’s Scholarly Communication and 1'echnology Project 



http://www.arl.org/scomm/scat/summertield3.html 



i Dec. 1994 


jApril 1995 


jMay 1996 


; May 1997 


j June 1997 


U PTT ! 60 Mhz 

j | Pentium 


60 Mhz : 
Pentium j 

1 „j 


| 120 Mhz 
| Pentium : 


200 Mhz 
MMX 
Pentium 


| 166 Mhz j 
| Pentium j 


Iram 1 8 MB 


f 8MB ] 


1 16 MB j 


1 16 MB 


! 16 MB j 


jHard Drive ! 540 MB 


[ ' MO MB j 


[S50GB n 


1.6 GB 


1.2 GB 


N^:T $2,099 
ishipping) ;j 


$2,099 1 

\ 


j $1,999 


$2,064 


$1,499 | 


iNote: This is an extract from Appendix 4. 



4.2.1.3 Household Computer Penetration & Internet Access 

Many market research reports estimate the penetration of computers and modems into U.S. 
households, access to and use of the Internet, and the like over the past few years. 

Unfortunately, the findings vary considerably for single points in time (see Appendix 5). Data 
from one source, Find/SVP, are summarized here. 

Find/SVP's Emerging Technologies Research Group issued the results of its latest survey in 
early May 1997. The telephone survey, conducted from February to April 1997, included 1,000 
adult current Internet users and 1 ,000 adult non-users. Its Web site 

(http://www.etrg.findsvp-com/internet/l has a substantive summary of its results. The report 
also summarizes historical penetration data back to 1994 and makes projections through 2001 in 
a chart (at http://www.columbia.edu/cu/libraries/digital/texts/forecasty') that tracks PC 
Households, Modem Households, Internet Households, and Non-PC Internet Access 
Households (NetTV). According to that chart, 

• PC households are increasing at a relatively moderate rate - from about 30 million in 1994 
to about 37 million in 1997 projected to about 40 million in 1999 and 46 million in 2001. 
U.S. households number just under 100 million, so these values approximate the 
household penetration as well - moving from the low 30's to about 46 percent. 

• Modem households started out in 1994 as about 40 percent of PC households, but the 
two values are converging over time to 75 - 80 percent modem penetration in 1997 and a 
projection of about 95 percent penetration in 1999 and thereafter. Virtually any new 
household computer purchased from 1997 on will be equipped with a modem. 

• Elsewhere, Find/SVP projects a rapid reduction in the market share of modems of less 
than 28.8 kbps - from 66 percent at year end 1996 to 30 percent at year end 1997 to only 
10 percent at year end 1998. They project that 56.6 kbps modems will have 10 percent 
market share at year end 1997 and 25 percent at year end 1998. These values reflect the 
sales of modems, not the stock of household computers, which will lag this changeover 
considerably. This suggests that scholars reliant on modems to access online resources are 
likely to have relatively slow connections for the next few years. On the other hand, 
modems are not costly, so if a scholar finds the online resources valuable, he may upgrade 
to a faster modem. 

• Internet households are following a similar pattern of increasing penetration within the 
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universe of modem households. Find/SVP estimates U.S. Internet households as: 

Table 5. U.S. Internet Households 



1 ] 

jYear 


j Millions i 
| of HH ij 


Penetration j 
of Modem j 
HH j 


1 1994 | 


Ef J 


25% 1 


j 1995 j 


] 6.2 




j 1996 ; 






1 1997 i 


21.9 j 


75% 


1 199.8 : 


28.0 




|l999 j 


33.0 | 


87% I 


12000 j 


136.5 | 


(2001 ; 


|40.0 | 


93% ] 



• While there are hardly any Non-PC Internet Access Households, i.e., those using 
NetTV-type systems, now, Find/SVP estimates that there will be about seven million in 
1999 and 24 million in 2001. 

• Based on telephone surveys, Find/SVP estimates that 8.4 million U.S. adults were current 
users of the Internet in 1995, 28.8 million in 1996, and 31.1 million in early 1997. They 
project that 36.3 million adults will be users by year end 1997. Find/SVP asserts that 55 
million Americans are poised to become Internet users. Scholars have a greater exposure 
to the potential of use of the Internet than do adults in general, so their rate of adoption is 
likely to be more rapid. 

• While Find/SVP found general enthusiasm about the Internet and the Web - about half the 
current adult Web users use it daily, they also found that nine million Americans have 
tried the Internet but are not current users. 

An early 1997 Baruch College-Harris Poll survey of 1,000 households found 21 percent of U.S. 
adults (40 million) using the Internet and/or the World Wide Web. This figure is half of all 
computer users and double the number using the Internet a year ago. An additional 12 percent 
of respondents use commercial online services. 



4.2.2 Columbia Socio-Technical Environment 

Columbia infrastructure, penetration of ready access to computing, and amount of time spent in 
online activities are among the Columbia socio-technical environmental factors that may affect 
adoption of online books. 



4.2.2.1 Campus Infrastructure: February 1997 
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its constant expansion to meet community demand for access to email and other Internet 
services. Currently, a lOBaseT fiber optic campus network connects 65 buildings and a T3 line 
connects the campus to the Internet. Over 9,000 ports are connected to the network and over 

20.000 computers are registered to community members. All fifteen undergraduate residence 
halls are pre-wired; the residence hall network has over 4,500 ports. Our modem pool is 
constantly growing to serve demand; 298 modems with SLIP/PPP support now handle over 

52.000 calls on a typical week. Email servers managed over 442,000 email messages in 1996. 
The campus has 366 public workstations, kiosks, and lab computers; all are connected to the 
network. 



4.2.2.2 Community Perceptions of Access To Computing Resources 

Is there a computer (in the library or elsewhere ) attached to the campus network (directly or by 
modem ) that you can use whenever you want? is one of two constant questions on our various 
questionnaires. The most recent response to that question to date came in the Libraries' onsite 
user survey in March 1997. 

• Almost 81 percent of the 2,367 respondents to this question answered Yes. This response 
indicates that, whether they possessed their own computers or not, most community 
members perceived that they had adequate access to networked resources. 

• Looking at the responses by cohorts using individual libraries, we find that the shares 
responding Yes varied from highs of 100 percent for 54 users of the Geoscience Library 
and 96 percent of 70 users of the Physics Library to lows of 59 percent for 312 users of 
the Business and Economics Library and 54 percent for 22 users of the Rare Books and 
Manuscripts Library. 

• As the following table shows, there is a statistically significant range to the responses by 
Columbia status. The particularly small sample of faculty members makes this value 
suspect. These values vary insignificantly from the equivalent survey a year earlier when 
the faculty count was 63. 

Table 6. March 1997 In-Library Survey: Is there a computer (in the library or elsewhere ) 

attached to the campus network (directly or by modem) that you can use whenever you 

want? 



[Cohort 


Sample Size 


: Responding YES'i 


[Faculty Member 


44 


| 86% |[ 


[Doctoral Student 


468 


| 85% 1 


[Masters Student 


611 


! 67% !| 


[Undergraduate 


1,065 


| 87% || 



In Fall 1995, we cooperated with the Office of the Provost in conducting a campus computing 
survey. The initial means of distributing this survey was an "opinion festival" in the rotunda of 
the main administration building. This festival was billed primarily as a food tasting; it attracted 
many students and few faculty members. The computing survey garnered 414 student responses 
-125 graduate students and 289 undergraduate students spread fairly well across the four 
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classes. To amplify the graduate student and faculty counts we did follow-up mailings - to a 
sample of 2,000 graduate students and all faculty members. Responses were modest in number 
and quite skewed by department, especially for the faculty survey, so these data are unlikely to 
be reliable. 

The share of Columbia community members reporting ready access to a networked-linked 
computer (the same question asked in the onsite library survey) by cohort is as follows. 

Table 7. Fall 1995 Campus Survey: Is there a computer (in the library or elsewhere) 
attached to the campus network (directly or by modem) that you can use whenever you 

want? 



iCohort 




ample Size 


1 Responding YES] 


jFaculty Member 




3 


[ 90 % ;| 


[Graduate Student 






1 80% i| 


[Senior 






| 65% 1 


[Junior 






| 63% 1 


jSophomore 






| 63% l| 


[Freshman 






[ 78% ij 



With such small sample sizes for the undergraduate cohorts, there is no significant relationship 
between the shares reporting such computer access and level of study. 

About 72 percent of undergraduates, 80 percent of graduate students, and 85 percent of faculty 
members responded Yes to the question Do you have your own computer in your residence ? in 
this survey. That these values are higher than those for the access question may reflect that 
some of the students do not have modems or network cards in their computers or do not use 
them. Questions asking for details about the power of these computers and the degree to which 
they have communications hardware were not answered fully. 



4.2.2.3 Community Use of Online Resources 

A related question that we ask on all of our questionnaires regards time spent on online 
activities. For the 1996 and 1997 onsite library surveys, this was phrased as On average this 
semester, how many hours per week do you spend in online activities (Email, Listservs & 
Newsgroups, CLIO Plus, Text, Image or Numeric Data Sources, Other WWW eh Uses) ? The 
respondent was instructed to write a value in the blank provided. 

The following table gives a grouping of the distribution of the total responses to this question in 
1997 in column 2, of the responses by those who claimed easy access to computers with online 
access in column 3, and of the responses by those who said that they did not have such access in 
column 4. 

Table 8. March 1997 In-Library Survey: Weekly Hours on Online Activities by Access to 
Computers Linked to Campus Network, Winter 1997 
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Percent of Respondents 


In Group 1 


r i 

\ i 

i Hours/Week 

| i 


All 

(N=2,493) 


W/Easy 

Access 

(N= 1,853) I 


W/O Easy |J 
Access l| 

(N=428) 1 


lo ! 


2.9% 


[t4% ~ ] 


5.6% | 


jl-3 j 


46.4% 


145*2% ] 


49.8% j 


14-6 


23.0% 


|23.8% 


21.7% i| 


[7-9 


6.1% 


j6T% 


7.5% 1 


lib- 12 


ii.7% 


112.4% 


9 3% | 


1 13-15 


3.2% 


;3.8% 


1.2% | 


|16-18 


0.4% 


jO.4% 


0.2% | 


jl9-21 


3.7% 


|4.0% 


2.8% ;[ 


[22-28 


0.6% 


[0.4% 


1.2% | 


[29-35 


1.2% 


jl.6% 


0.2% 1 


IMore than 
[35 


0.8% 


io.9% 


0.5% 1 



Even those who answered No to the previous question, i.e., they do not feel that they can use a 
computer attached to the campus network whenever they want, report spending substantial time 
on online activities each week (column 4 data). The mean number of weekly hours in online 
activities reported by those who reported any such use was 5.8 hours, with the greatest amount 
reported 60 hours (8 respondents). 

Another way to look at these data is to group the responses by Columbia status of the 
respondent. This is done below for the four major scholarly components of the community. The 
cohorts include only those individuals who provided status information. Time spent in online 
activities was quite consistent across cohorts within the Columbia community; differences 
among cohorts were not statistically significant. 

Table 9.March 1997 In-Library Survey: Weekly Hours In Online Activities by Columbia 

Status, Winter 1997 
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Percent of Respondents In Gr 


oup I 


jHours/Weel 


Undergrade 
< Students 

(14=1,107) 


ItiMasters 
1 Students 

| (N=649) 


| Doctoral 
| Students 

| (N=477) 


Faculty ;| 
Members! 

(N=45) ;| 


jo 


2.1% 


|Z5% 


\ij% j 


6.7% I 


1 1-3 


49.4% 


[448% 


;442% ! 


333% 1 


[4-6 


22.4% 


[23j6% 


I 23 ' 1% | 


26.7% 7 


(7-9 


6.7% 


[6.2% 


|6.3% 


0.0% ji 


| 10-12 


10.2% 


1 12.9% 


113.8% 


17.8% 


[l3-15 ] 


2.6% 


[3 ~A% 


j3L8%~ 1 


0 % ! 


ji6-18 


04% 


[6' 5% 


|0j5% 1 


(16% ™ 7 | 


[79-21™ 1 


3.3% 


[l9% j 


|i6% 


44 % ;| 


[ 22-28 


0.4% 


|77i% 


[676% : 


()76% 1 


[29-35 ' 


13% ~ 


[679% 


hL7% ; 


17% ™1 


iMore than i 
135 


1.3% 


j().3% 


jo.6% 


0.0% 


[Mean 





[779 | 


163 ; 


63 



Differences in reporting make comparison with the 1996 results difficult, but it appears that 
average weekly hours online increased modestly from winter 1996 to winter 1997. 



4.3 Findings On Use Of Books In Online Collection 

At this point we will report on (1) trends in use of the CNet and CWeb books; (2); user location 
and cohort as suggested by host computer address; (3) distribution of use by day of week and 
time of day; (4) patterns of hits per Web session involving online books for two weeks’ use and 
for the overall use of three social work titles; and (5) use of the online books by individuals from 
March 15 to May 31, 1997. Summarized below are findings in these areas for the various 
groups of books. 



4.3.1 Reference Books 

4.3.1.1 Total Use Over Time 

Three reference works have been available online long enough to have generated substantial 
usage data. These are The Concise Columbia Electronic Encyclopedia, Columbia Granger's 
World of Poetry, and The Oxford English Dictionary. The three Garland titles have been online 
only since the turn of the year or later, so our usage data are very short term for these titles. All 
three are accessible both through CNet and CWeb. 

As of the time of this writing, CWeb usage data extended only through March 14, 1997 on a 
monthly basis. With the exception of Columbia Granger's World of Poetry, usage (number of 
hits and unique users) from March 15 to May 31, 1997 was reported as a single number. No 
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data are available for Granger's after March 14th. In the CWeb data reported below, the early 
March data is included with the newer data to give one value for the three month period of 
March to May. 



4.3.1. 1.1 Concise Columbia Electronic Encyclopedia 

The Concise Encyclopedia remains on the older CWIS-gopher platform CNet. Usage declined 
84 percent over the past three years, from 1,551 sessions in April 1994 to 250 sessions in April 
1997. Usage has declined most in the current academic year; 7,861 sessions were registered 
from September 1995 to May 1996 and 2,941 sessions (63% fewer) from September 1996 to 
May 1997. 

Graph 1. Concise Columbia Electronic Encyclopedia Sessions, 1994 - 1997: CNet 
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Potential reasons for this steep decline include: 

• As community members have become more familiar with the Web, they may be searching 
it for answers that they might have sought in the Concise Encyclopedia when it was our 
only online encyclopedia. 

• Columbia scholars should still be familiar with CNet and the library component, 
CLIO-Plus, since the library on li ne catalog (CLIO) resides there, but the presence of 
periodical indexes and the like on the Web has shifted attention away from CLIO-Plus. 

• Often encyclopedias on CD-ROM come bundled with new computers; many scholars may 
own or otherwise have access to these alternatives to the CCEE. Those who subscribe to 
America Online, Prodigy, or CompuServe can use the CCEE or similar resources on those 
online services. 

• Columbia now provides CWeb access to the Encyclopedia Britannica (directly from the 
publisher's server); scholars may be using this instead of the Concise Encyclopedia. In 
December 1996, the Columbia community registered 15,436 hits on the Encyclopedia 
Britannica, up from 8,236 hits in September and 1,096 hits in July. 

Columbia scholars seldom use the print copy of the Concise Encyclopedia, which resides behind 
the Reference desk. Its larger cousin, which is out in the public area, sees much greater use. We 
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plan to put that longer, one volume CUP encyclopedia online on CWeb this year. Its use 
patterns will be instructive. 



4.3.1. 1.2 Columbia Granger's World of Poetry* 

Columbia Granger's World of Poetry is available on both CNet and CWeb. The CNet version is 
a lynx, non-graphical Web, formulation of the CWeb version. This resource, which became 
available to the community in online form in October 1994, locates a poem in an anthology by 
author, subject, title, first line, or keywords in its title or first line. In addition, it provides easy 
access to the 10,000 most often anthologized poems. As the following table shows, total usage 
declined from 1996 to 1997 - by 49 percent from the first quarter of 1996 to the first quarter of 
1997. Even so, the 4,289 hits for 1996 is considerable. 

Reference librarians report no more than a handful of uses of the print version of Granger's each 
year; it is kept behind the main reference desk and lacks the database of poems. The CD-ROM 
version, which is kept in the Electronic Texts Service, has the same functionality as the online 
version; it is used once or twice a month on average. 



Table 10. Columbia Granger's World of Poetry: Number of Hits by Month 



r 


CNet 






CWeb 




[Total CNet & % Change for 

CWeb Total 
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|l997 1 


1995 
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|l995 


|l996 j 1997 
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to 
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1 '95 1 


! '96 


'97 


IJan. jO 


222 ] 


|9f J 


fTFj 


?r 


;|466 


1 150 


f — — 

^222 


11557 11168 


| 


[151% 


-70% 


IFeb. <0 


704 ” 


f|37 


hi II 


o' 


1282 


1312 


[204 




: 

1 

1 


105% 


-18% 


jMar.fO 


292 


|% 


pn 


(T 


1465 


1236 


|292 


H56f 1277 




92%': 


^51% 


i April iO 


T 99 ] 


173 


1 34 


W'ZI... 


1278 


|na 


[199 7 


;|35i Jna 




76%; 


NA : 


iMay jo 


134 


lo 


i 17 " 1 


|682 


1199 


Jna 


[816 


;|277 jNA ] 


| 

i 


i-66% 


NA 


[June jo 


81 


[30 J 




695 


"1[102 


|na 


|776 


||239 |NA 


! 

1 


-69% 


NA ; 


|July*jO 


80 || 


|71 ! 




1550 


|383 




[630 


1 1464 | 




[-26%; 




jAug.|0 


78 [j 


[53 : 




161 


;|27 




[845 


:|83 




-90% 




ISept.jO 


76 | 


[58 j 




596 


|l79 




|672 


[1238 | 




[-65% 




jOct. Jna 1 


162 || 


[84 j 




863 


|262 




1 1,025 


1348 ; 




i-66% 




jNov.pUl 1 


114 s 


[50 | 




[800 


1413 




[914 


1465 1 


494% 


[-49% 




|Dec. 1207 :i 


68 i 


[28 1 




725 


||257 




[793 


1287 1 


|283% 


-64% 




|Tota|NA |! 


1,710|806 




5,678 


! 3,483 




[6,758 


[[4,289 [ 


NC j 


-37% 




Note: * July 1995 CNet hits are estimated. CWeb data are available through 
|March 15, 1997 only; this estimated value is twice the actual count. 



4.3.1. 1.3 The Oxford English Dictionary 
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At this time, The Oxford English Dictionary is the most heavily used reference work in our 
collection. As noted earlier, it is available on both CNet and CWeb, with the former format 
having greater functionality but being quite opaque. Users find the latter attractive and easy to 
use, but it only permits them to look up a definition or browse through the contents. 

Usage of the CNet version dropped 59 percent from the fourth quarter of 1994 (2,856 hits) to 
the first quarter of 1997 (1,167 hits). The CWeb version attracted greater use than the CNet 
version from its first months. Total usage of the resource was greater with the two versions in 
place than with only CNet, by 55 percent in February 1997 versus February 1995. 

Table 11. Oxford English Dictionary: Number of Hits by Month 





CNet 


| CWeb 
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Pl 7 % 
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1 6,926 16, 1541 NA 


r na 
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8,0691 NA 




[- 11 % 





Note: * July 1995 CNet usage is estimated, as the true value was 
unavailable. 



# March - May 1997 hits; these data are somewhat under-counted as 
The OED was not included in the user-identified data set initially and 
as one form of bookmarked access was not included for the whole 
period. The OED became available on CNet in August 1994, but 
usage data are available back to October 1994 only. 
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Columbia College has a one semester Logic and Rhetoric course that is required of all its 
students (about 1,000 each year). Students in this course must complete an assignment 
involving the OED and are encouraged to use an online version. That assignment occurred in 
October 1996 and mid-February to early March 1997. In the period preceding mid-March 1997, 
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almost 42 percent of the hits (1,531) on the CWeb OED came from computers in dormitory 
rooms, suggesting that students are using this resource. This conclusion is confirmed by the 
analysis of the data by user in the period beginning in mid-March; see section 4.3.4. 

Observation and reshelving activity show that scholars frequently use the print copy. However, 
statistics on use are unavailable as scholars have direct access to several sets in libraries around 
campus and have not been cooperative in recording use of volumes. In addition, scholars often 
owned their own copies of the compact edition of The OED. Finally, some serious scholars use 
the CD-ROM version in the Libraries’ Electronic Text Service which allows refined searches 
with a search engine that is more attractive and user friendly than that in CNet. 



4.3.1. 1.4 Garland Reference Works 

Garland’s Chaucer Name Dictionary was added to the CWeb collection at the end of 1996. 
Native American Women was added in January 1997 and African American Women in February 
1997. The first two were added to the CNet collection in February 1997 and the third in March 
1997. 

Table 12. Garland Reference Works: Number of Hits by Month, December 1, 1996 - 

May 31, 1997 
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h 
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Total 

* . 


[269 : 


|33 


302 "1 
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\49 


|l73 


1230 | 


125 " 


[255 



r v — - * 

iNote: # March - May 1997 hits. NA - Resource was not available. ND: 
[Data are not available. 

INC - Not Calculable. 



CWeb is a far more popular means of access to these resources than CNet. Although Chaucer 
Name Dictionary and African American Women were both available on CNet from February 
3rd, their usage on CNet in February was only 10 to 15 percent of that on CWeb. The Libraries' 
print copies of these reference books are lightly used, so these hits signify substantial expansion 
of use of these books. 



4.3.1.2 Host Computers for Reference Book Use 
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A user location analysis acts as a proxy for user cohort for the early use data. We have grouped 
host computers into the following ten categories. 

cc - mainly computers in public labs 

cul - computers in the libraries 

cunix - in general on campus computers linked directly to a cunix server, also now the 
host computer for Granger's 

cupress - computers at CUP 

dialup - computers connected by dialup modem 

english - computers in the English department 

pols - computers in the Political Science department 

rhno - computers on the residence hall network 

sipa - computers at the School of International and Public Affairs 

ssw - computers in offices and labs at the School of Social Work 

other - computers at all other Columbia locations 

The distribution of use of the five reference works supplied via CWeb across these categories is 
shown below. With the exception of the three Garland books, a very small share of the uses of 
these reference works occur on computers in the libraries; the Columbia community is taking 
advantage of the out-of-library access to these resources. As noted earlier, a large share of the 
use of The OED occurs from students' on campus residences (rhno host computers). 

Table 13. Host Computers for Reference Book Use, May 1, 1996 - March 15, 1997 - 

Percent Distribution 
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[Host 
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Jcc ii 
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[Notes: * In the later part of this period, a Cunix i 
[server was given as the host computer for all uses of ij 
\Gr anger's. ij 

| I 

** Less than .5% !l 
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4.3.2 Monographic Books 
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4.3.2. 1 Total Use Over Time 

The Online Books Project includes three collections of monographic books for which we now 
have some use data. These are (1) Past Masters, classical texts in social thought; (2) Columbia 
University Press Monographs, mostly contemporary social work books; and (3) Oxford 
University Press Monographs, contemporary philosophy and literary criticism books. Most of 
these books came online during the 1996-97 academic year. 



4.3.2.1.1 The Past Masters Collection 

Until July 1996, ten Past Masters texts were available to the Columbia community online; since 
then, 54 texts have been available. 

As Table 14a shows, from September 1996 to May 1997, the Past Masters texts registered 
about 2,460 hits from the scholarly community. Table 14b displays the number of hits on the 
eight most heavily used of these texts for the period from September 1996 to May 1997. This 
group of texts registered 1,692 hits from the Columbia community, or about 69 percent of the 
total usage for the Past Masters for this period. Thus, in a collection of texts that was not 
specifically selected to meet the specific needs of a set of users, we find that 15 percent of the 
texts accounted for 69 percent of the usage. The other 46 texts averaged about 17 hits each 
over this period, or about two hits per month. 

Patterns of usage may be expected to change over time as various texts are used in courses or 
by researchers and as the Columbia community becomes more aware of the online books. It will 
be interesting to see how usage of the Past Masters evolves over the next academic year. The 
data to date remind us that to the extent that there are meaningful costs to creating online books 
(or journals) and to maintaining them as part of a library's collection, planners must select items 
for the online collection carefully. Of course, the decision rules for a consortial approach will be 
different from those for a group of non-cooperating individual libraries. We are attempting to 
delve into these cost issues and hope to have some findings by the end of 1997. 

Table 14a. Past Masters On The Web, Total Monthly Hits: May 1995 - March 1997 
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IMonth il 


1995 1 


1996 ! 1997 ! 


| January |] 


’ NA [ 
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: NA 
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[March [j 


— | 
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| April | 


r na 


1,423 | #205 i 


IMay || 
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[June i| 
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1 July | 


r:ci 


r ’’ 513 ’ij 
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340 [ 


1 September ij 


ED 


L 330 i 


[October || 
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[November [j 


i 619 ^1 


r’ " 604 ] 


[December || 


| 225 
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[Note: Early data include a substantial share of 
[Project development hits as work was 
[progressing on the texts. # March - May 1997 
[hits. 



Table 14b. Key Past Masters Texts On The Web, Monthly Hits: August 1996 - May 1997 
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| Note: Values that are in bold indicate that the text was in use in the Columbia 
[College Contemporary Civilization class in that month. Other Past Masters 
jtexts used in that course (Locke's Second Treatise on Civil Government ) did 
|not make our heavy use list. * This text was on reserve for one or more 
jcourses during this semester. # March to May 1997 hits. 



4.3.2.1.2 Columbia University Press Monographs 

Cross title comparisons are difficult because books were made available to the community at 
different times - from September 1996 forward. Our design breaks these books into chapter files 
in most cases, so a hit gives a user access to a whole chapter if he gets beyond the Table of 
Contents file. As Table 15 shows, scholars are using these online books. 



4.3.2.1.2.1 Social Work Books 

In the period from May 1, 1996 to May 31, 1997, the social work books received a total of 
1,948 hits, with a peak in October of 353 hits. The October peak reflects the use of the three 
books with the most hits in classes in the School of Social Work. Bold values on Table 15 
indicate months in which we are aware that the book was being used in a class. If faculty 
members did not put the books on reserve in the library, we may not know that it was in use in a 
class. Also in many cases, although we know the book was used in a course, we do not know in 
which months. The secondary peak in February 1997 (278 hits on social work books) also 
reflects class use of the two titles with the greatest number of hits. 

We informed the social work faculty of the availability of the online availability of these books in 
several ways over the months preceding their introduction. Furthermore, we requested 
permission of these instructors to conduct in-class surveys at the time they were discussing the 
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material from these books. These steps seem to have led the instructors to inform their students 
of the availability of these books online and to have caused some faculty and students to look at 
the online books. In the Spring 1997 term, we also provided handouts about the Social Work 
collection to several classes that were using books included in the collection. 

Table 15. Scholarly Hits on Columbia University Press Books, May 1, 1996 - May 31, 

1997 
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Note: Numbers preceding titles indicate the month the book was made openly 
accessible to the community. l=Sept. 1996 and on through the months. Bold 
values indicate months in which the book is known to have been used in a 
course; * indicates that the book was on reserve for one or more courses 
during the semester, but month(s) of use are not known. # March - May 1997 
hits. 

[The following books had no hits by the end of May 1997: Ozone Discourses, 
i Jordan's Inter - Arab Relations, Hemmed In, Managing Indonesia. 



4.3.2.1.2.2 Other Works 



The two earth and environmental science titles had 192 hits; the political science title received 
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55 hits. While these values do not seem large, they should be thought of in the context of the 
number of uses that a print copy would receive in a similar period if it were not on reserve for a 
course. If it is recalled almost at once, a book will circulate at most about six times during a 
semester. Books on loan are also unavailable for serendipitous use by scholars. For example, the 
two earth and environmental science titles had a total of only two circulations over the past 
three years. 

As the following table shows, the paper copies of these books have experienced substantial 
circulation, some regular and some reserve, over the past three years. It does not seem that 
circulation of the print copy has declined with the introduction of the online versions. In fact, it 
is likely that online availability has created an expanded audience for at least some titles. Further 
analyses of the print circulation data will be conducted during summer 1997 to determine if 
additional expansion of use or new shifts in use can be discerned. 

Table 16. Columbia Circulation of Columbia University Press Monographs: 1994 - 1996 
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4.3.2.1.3 Oxford University Press Monographs 




The first Oxford monographs were introduced to the Columbia community in mid-Fail 1996. Six 
books of literary criticism and 12 of philosophy were online by June 1997; Tables 17a and 17b 
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detail the month of introduction and the usage for each. The literary criticism titles received 92 
hits through May 31, 1997; the philosophy titles 626 hits. 

None of these books was on reserve for a course Fall 1996 or Spring 1997. This is not 
surprising. Few monographs in the Libraries collection are on reserve for courses. Also, faculty 
members may take a while to become acquainted with newer monographs and to decide to 
include them in a course. Potentially, a great value of placing new monographs online will be in 
helping scholars to maintain current awareness in their fields of scholarship and teaching. 

Table 17a. Scholarly Uses (Hits) Oxford University Press Monographs In Literary 

Criticism, May 1, 1996 - May 31, 1997 
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May 1997. 



Table 17b. Scholarly Uses (Hits) Oxford University Press Monographs In Philosophy, 

May 1, 1996 - May 31, 1997 
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o i 


|o 


2 1 


6 - 


9 j 


0 


4 1 


|l : 


14 | 


33 


#1 


1 1! 

| 70 | 


{Society 


























| Nietzsche's 
\System 


0 1 


I 3 


0 I 


0 | 


7 1 


0 


o I 


I 7 S 


7 


2 


#9 


[□I 


{Other Minds: ; 
j Critical Essays j 


2 


I 3 


5 i 


0 j 


5 || 


0 


15 | 


I 9 3 


12 j 


2 3 


#39 


j ll 3 || 


j. Philosophy of 
| Mathematics ... ij 


0 I 


|o 


0 j 


0 ! 


8 1 


|o 


2 


I 3 I 


2 


0 


#6 


| 21 j 


j Real Rights 


[pi 


|o 


O! 


|o 


[Oi 


lo 


0 J 


|o j 


\f’j 


|T 


#3 7 [ i 


[ 22 [|| 


nT j 

| Expressions : 


4 1 


|24 


14 j 


I 2 : 


I 7 I 


|o 


4 


I 2 : 


9 I 


bo 


#21 


117 i 


{The Logic Of 
{Reliable 


0 1 


I 3 


o I 


|o 


6 1 


|i 


2 1 


I 4 1! 


3 1 


i 




1 29 j 


;| Inquiry 


























| Total 


[T] 


I 34 ' 


40 ] 


[l6 


!79J 


!i[ 


42 


|48 j 


f7lj: 


|136 


#15 3 OZj 


[626 |j 



jNote: Numbers preceding titles indicate the month a book was made openly 
j accessible to the community. Earlier use is by individuals who knew the 
jnon-public addresses for the books. All of these books, with the exception of 
| Law & Truth, became available to the community in October 1996. Law & 
{Truth became available in November 1996. # Total hits March - May 1997. 



Table 18. Columbia Circulation of Oxford University Press Monographs: 1995 - 1996 
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1/1995 J 


2/1995 ! 


1/1996 I 


f 2/1996 : j 


i Total ij 


1 Children's Literature & 










i 


\ Critical Theory 










\ 

\ 


["Littery Man"* 


6 ’ 1 


o j[ 


0 ] 


[~1~J 


i i i 

: ■} 


L Majestic Indolence 


o j 


i r 


0 j 


H’"’p7'j 


r t™i 


\Novel & Globalization of i 
j Culture 


° i 


1 1 


3 | 


0 


4 ; t 


[Poetics of Fascism 


6 ii 


i o ii 


3 


0 


3 !! 


L Autonomous Agents 






1 | 


[’’ 2 


mil 


[Bangs, Crunches, 
i Whispers & Shrieks 










\ 


[Free Public Reason: 










\ 

i 


[Freedom & Moral 


0 


0 ij 

i ;; 


1 


1 : ' 

i 


! o 


[Sentiment 


: ^ 


[Law & Truth: 










1 

} 


[Morality, Normativity & ij 
| Society 


rri 


f :: 

t 

1 i 


o 


2 


3 j 


[Nietzsche's System* 


! o 1 


r o r 


' J 


2 | 




[Other Minds: Critical 
[Essays 


0 ; 


j :i 

j 1 I 


o 


0 ! 


1 :l 


[Philosophy of 
[Mathematics... 










\ 


[Real Rights 










1 


[Self Expressions: Mind, 
[Morals &...* 


0 


1 T 

0 1 


0 |j 


3 


3 1 


[The Logic Of Reliable 
j, Inquiry 












|Note: * Title acquired in 1996. Data for the titles with blank cells were not 
jcollected in the report on circulation, either because they had not circulated 
| through December 31, 1996 or because the Library Systems Office did not 
iinclude this book in the report; they will be provided in the report in July 1997. 
IA review of the online catalog shows that most of these books have circulated 


recently. 













Although data on the Columbia circulation of the paper copies of these Oxford books are 
incomplete at this point, it is clear that these books have some interest for the Columbia 
community even though they are not on reserve for courses. They are circulating, while some 
other books sit on the shelf for years before someone checks them out. 

One title that did not circulate greatly ( Other Minds) was held by one scholar for 347 days from 
late 1995 through much of 1996, thus depriving other members of the community of the 
opportunity to encounter it, to determine whether it might be of value to their work, and to read 
it closely. As noted earlier, a key advantage of online books is their ready availability to the 
whole community at all times. The online version of Other Minds received 39 hits in 1996. 
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4.3.2.2 Host Computers for Monographic Book Use 

The host computer categories used in analyzing the location of use of the various books were 
defined earlier. Looking at the Columbia University Press and Oxford University Press books as 
a whole, we find the distribution given below. 

Table 19. Host Computers for Monographic Book Use, May 1, 1996 - May 31, 1997 



Host Computer 1 


Columbia 


Oxford University || 


{Type 


University Press |j 


Press 


|cc 


2% 1 


15% ij 


|cul 


19% 


33% i| 


jcunix 


11% 


15% 


j cupress 


12% 1 


2% i| 


{dialup 


11% ; 


17% l| 


jenglish 


()%"'' ” ’ 


1 % ’ | 


jpols 


o% l| 


0% ;| 


jrhno 


1% 1 


13% !| 


jsipa 


T% I 


j* 


jssw i 


141% II 


\l2%~~ :j 


{other 


|5% 


112% 1| 


{Note: * Less than 0.5%. 



The detailed data on the host group for each book in the collection confirms what one would 
expect from these data — host computer type is related to book type for the most part. 
However, once a group within the community becomes aware of the online books, they are 
likely to review other books in the collection (at least in this early stage when the collection is 
small). For example, half of the use of Autonomous Agents: From Self Control to Autonomy 
was from social work host computers. This is a title that might seem related to social work 
issues even though it is not one of the Columbia University Press social work books or part of 
the collection of the Social Work Library. 

SSW was the host location for the following shares of the hits on the social work titles: 



Handbook of Gerontological Services 53% 



Mutual Aid Groups , Vulnerable 
Populations 

Philosophical Foundations of Social 
Work 

Qualitative Research in Social Work 

Supervision in Social Work 

Task Strategies: An Empirical Approach 



76% 

39% 

69% 

48% 

68% 
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Closer analysis of the usage data finds substantial use from the computer lab in the Social Work 
School as well as from faculty computers. This suggests that many of these graduate students, 
most of whom do not live on or near campus, may not have Web access in their homes and, 
hence, at this point in time, are not equipped to take full advantage of the online books from 
home. Use of the online version enables them to use the books from the School, however, thus 
avoiding the walk of several blocks to the Social Work Library. 



4.3.2.3 Use By Day And Time — All Types of Books 

Table 20 gives the breakdown of use of the online materials by day of the week for May 1, 1996 
to March 15, 1997. Table 21 gives the breakdown by time of day for the same materials for the 
same period. 



The patterns of use varied considerably among the families of online books. For example, 79 
percent of the use of The OED, 80 percent of the use of the Oxford monographs, and 91 
percent of the use of Columbia monographs occurred on weekdays. Friday alone accounted for 
25 percent of the hits on Oxford monographs and 20 percent of the hits on Columbia 
monographs. This concentration of use is not surprising, as few classes meet on Friday at 
Columbia, making it a good day for both faculty and students to do research and class 
assignments. We will track future data to see if these patterns continue. 



Table 20. Patterns of Use from Web Server: May 1, 1996 - March 15, 1997 Hits 





_ , [[ Past [Oxford i 

rangers jjy| asters [English j 

roetry Texts [Dictionary 


[Garland 

[Books 


OUP j CUP 

Monographs Monograp 


ihs 


[Day of 
[Week 


Num 
[ ber 


% of [ Num [ % of [Num % of j 
Total [ ber ;j Total [ber] Total j 


Num 

ber 


% of [ 
Total 


Num 

ber 


% of [ Num 
Total i| ber 


% of 
Total 


[Monday 


1360 


15% !jl,338:[26% [j739[20% j 


[137 


[26% i 


74 


11% [ 247 


12% J 


Tuesday 


|361 i 


15% 1|l,090|21% [597116% j| 


144 


[27% '[ 


r~ 


13% i! 439 


20% j 


[Wednesday [ 


|456 : 


19% [[741 |l4% |619|l7% 


93 " 


|l8% [ 


1 101 [ 


P 15% 1 416 1 


19% 


[Thursday 


[273 


11% fill [14% [447[12% 


43 


[8% i 


1 101 


15% i 429 i 


20% 


Friday 


486 


20% :|672 [|l3% l484|l3% ij 


[51 


|l0% j 


f 166 


25% :| 423 


20% 


Saturday 


198 


i8% $224 14% 12660% l| 


16 


[l% 1 


! 55 


8% ii 99 ! 


5% ' 


JSunday 


|268 


[11% i|420 [18% [[52014% [| 


[56 


[ii% j 


| 74 ; 


11% | 96 


4% 


[Total 


[2,402 


j 100% [5,196 |l 00% |3,6j 100% 


530 


[ 100 %] 


| 656 


100% j 2,149 ; 


100% 


[Weekdays: [ 


1 1,936 


181% [|4,552]88% ;|2,8^79% j 


[468 


[88% [ 


[527 


80%][ 1,954 [ 


91% 



Table 21. Hits by Time of Day: May 1, 1996 - March 15, 1997 
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| Granger's 
| Poetry 



Past 

Masters 

Texts 



[Time 
j Period 


Num 

ber 


of 

Total 


Num! 
ber [ 


% of 
Tota 


Num! % of 
ber [Total 


Vumij % of [Num 
ber [Totalj ber ! 


[Midnight 
6: AM 


243 


10% 


375 | 


7% 


560 


r- : 

! 

| 15% 

| 


TTi ; 

|| 12% J69 j 


[6: AM - 
[Noon 


[365 


15% 


1,193 


23% 


405 


! 11% 


125 [ 24%; [96 : 

1 1 . . 


[Noon - 
|6: PM 


1 1,275 


53% 


2,199 


42% 


1,288! 35% 

\\ 


259 1 49% [386 ! 

if l\ [ 


|6?PM - 
[Midnight 


[519 


22% 


1,429 


28% 


1,419 39% 


: 

81 1 15% 1105 I 

[j ij i 


? vcTvo] 

> j 

j 


|482 


20% 


1,202 


23% 


1,271 j 35%: 


122 [j 23% jl 15 [ 

4..... 1 


[9: AM- 
19: PM 

i. 


1 1,920 


80% 


3,994 


77% 


2,401 i 65% ; 


408 1 77%i|541 j 



Oxford 

English 

Dictionary 



Garland 

Books 






OUP 



CUP 



MonographMonographs 



I Total 

1 10 % 

! 15% 

1 59% 

1 16% 

1 18% 

I 82% 



46 



Num! % of \ 
ber [Totals 



I 2% 



381 1 18% 



:| 

1, 275159% 

; j 

447 I 21% 

\i 

148 j 7% 
2,001 1 93% 



The time of day analysis finds: 

• The use of reference books occurred mostly in hours in which the libraries are typically 
open, i.e., between 9: AM and 9: PM, but a meaningful share - 20 percent ( Granger's ) to 
35 percent ( OED ) - occurred from 9: PM to 9: AM. 

• The use of online monographs occurred almost totally (93 percent for the Oxford 
monographs and 95 percent for the Columbia monographs) in hours in which the libraries 
are typically open, i.e., between 9: AM and 9: PM. Users of these books do not seem to 
have been taking advantage of the constant availability of online materials. This suggests 
that these books may have been receiving a large share of their use from computers in the 
libraries or elsewhere on campus, such as the computer lab in the School of Social Work, 
that are used predominately or exclusively during work hours. The distribution of use by 
host type is discussed in the preceding section. 

The online versions of these books provide scholars with the flexibility of access to materials at 
times of the day and week when they cannot use them in the libraries, either because the 
libraries are not open or because the scholars are not able or willing to be in the library at that 
time. This flexibility is likely to enhance the scholar's efficiency and effectiveness, but use 
patterns do not yet indicate that it is being exploited. 



4.3.3 Session Analysis for Use of CWeb Books 



4.3.3.1 Two Weeks' Sessions - All Online Books 



We extracted the Web session data for the online books for the weeks of October 26 and 
December 7, 1996, in order to learn about the number of sessions and the number of text hits 
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per session. The analysis involved looking for what seemed to be sequential hits from the same 
address, i.e., ones that were very close in time, and counting those as part of a session of using 
online books. 

The number of sessions in the second week (212) was one- third greater than in the first week 
and the number of hits (611) was twice as great. The mean session included about two hits in 
the first week and three hits in the second. Several sessions seemed to involve systematic 
retrieval of many files. 

One way to put this usage into perspective is to compare it to use of other library-related 
electronic services. In December 1996, bibliographic indexes on CLIO-Plus, the Libraries 
component of CNet, had a total of 16,740 hits (or about 4,000 per week). However, individual 
indexes sustained monthly usage ranging from 28 hits (AGELINE) to 2,743 hits (MEDLINE). 
In fact, only MEDLINE sustained an average number of hits per week that was greater than the 
number of hits to online books in the December 1996 sample week. 

Table 22. Online Book Usage (Web): Hits Per Use Session 



J 


Week of Oct. 26, 


1996 


jwee^of Dec. 7, 199*6 i 


i Hits Per i 


; #of 1 


i % of 1 


# of Hits 


j #of 


i % Of jj 


#of 


• * ! 

I Session 1 


SessionsISessions! 


1 Sessions! Sessions! 


Hits 


: 1 ; i 


90 1| 


58% 1 


90 


1102 


[48% 1 


1102 ! 


f 2 || 


38 | 


25% j 


76 


j56 


1 26 % 1 


112 ; 


3 i| 


9 jj 


6% 1 


21 


Il7 


|8% | 


51 


4 j| 


2 |j 


1% ij 


8 


[9 


p% ; | 


36 


5 jj 


4 jj 


3% j 


120 


|4 


p% : 


20 j 


6™"j| 




3% 1 






i|2%::i 


24 


7 | 


2 ij 


1% jj 


14 


13 


:|l% :j 


21 


no 


— i 


3% j 


32 




'(3% I 


48 


[" 9 ~ j 


0 jj 


()% j 


o | 


\2 


]l% | 


18 


f 10-15 ; 


1 ]j 


i% 1! 


11 


13 


;|0% ! 


39 ] 


1 16-20 




o%' ; 


6 r 


(2 


I!% 1 

. > • : 


36 


21-25 ;| 




0% 1 


o' 


io 


(6% i 


0 


1 >25 '1 

: :i 


szn 


0% 


[6 


|4 ]2% 1 


104 j 


[total ij 


154 i 


400% 11 


1302 


i212 


]jioo_ 


|6ii ; 



4.3.3.2 Sessions for Social Work Books 



As noted earlier, in Fall 1996, three social work books were most intensively used as they were 
assigned reading for courses. We analyzed the server statistics through the end of 1996 for these 
books in an effort to learn how deeply the books were used - to what extent use sessions 
included book chapters, the search engine, the pagination feature, and the like. 
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• Relatively few sessions (7% - 24%) involved someone going to the Table of 
Contents/Title page for a book and stopping. 

• Many sessions (28% - 59%) involved use of more than one chapter of the book; sessions 
averaged 1.4 to 3.5 hits on chapters, depending on the book used. 

• Some users would seem to be repeat users who had bookmarked a chapter in the book or 
made a note of the URL as some sessions (9% - 17%) did not include a hit on the Table 
of Contents/Title page. 

Summary data follow: 

Table 23. Session Analysis for Social Work Books, Fall 1996 
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Handbook of || 
Gerontological \ 
Services | 


Supervision in |j Task Strateeies 
Social Work ij strategies ^ 


IN umber of 
IChapters/Essays | 
jin Book 


| j 

10 chapters :j 


10 chapters 11 chapters 


Sessions 


| 41 ;! 


46 jr~~ "[58’'’[ ] 


[Hits 


128 J| 


! 128 ]j 284 1 


jMean 

iHits/Session 


3.1 j| 


2.8 |] 4.9 


jSessions with 
ITable of 
jContents Hit 
! Only 


i ij 

4(10%) 

| ij 


11(24%) i! 4(7%) 


1 Sessions with No 
ITable of 
IContents Hits 


i 

| 7 (17%) ;| 

l i! 


7(15%) Ij 5(9%) 


ISessions with >1 
IChapter Hits 


15 (37%) 


13(28%) ij 34(59%) 


ITOTAL HITS 
[ON: 


L t , || Average/! 

i Number • 0 
: ij Session ij 


1 Number ! ^, Ver f^ 1 Number | 
ij Session ij 


Average/; 

Session 


ITable of 


38 l|.9 


47 ||l.O |60 


1.0 


IChapters 


74 JImIZZiI 


;63 ]jl 4 [ 262 ' Jj 


3.5 j 


IPage Locator 


EIZjIXIZj! 


[3 Ill' IF 1 




1 Search 


ETZE” 


!10 [2 [[ |4 :i 


[1 1 


IBibliographic 

IPage 


j ■“ ■ 

I 5 il* 1 [ 


14 |l 19 |j 


.2 


lAuthor 
1 Biography 


!l ij* i 

1 '■$ 


1 ||* :|2 : 


* 


jNote: * Less than .05. 



4.3.4 Analysis of Unique Users Of Online Books 

As of March 15, 1997, the online books system required users to sign in with email address and 
password, for all of our collection except The OED and Granger's Index to Poetry. This 
information can be combined with that obtained from the university's directory of its students 
and staff to obtain demographics on individuals who are using our books. Information on 
session behavior will be available late summer 1997. Summarized below are findings for the first 
period of 11 weeks, from March 15 - May 31, 1997, under the new system. Final exams for the 
Columbia spring semester ended on May 16th with graduation on May 21st. Thus, most of the 
period under analysis was a busy part of the academic year with only the last few days part of 
the early summer lull. 
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4.3.4.1 Use and Users 

In this period, the collection (absent The OED initially) was used by 280 different persons 
making 1,439 hits, for an average of over five hits per user. One or more persons used 45 of the 
books in the collection. Looking at two data periods, we find use breaks down as follows: 



Period 


i :! Mean i 

• | i Hits/Week 


1 Unique j Mean 
| Users l! Hits/User 


March 15- April 14 


1-591 | 138 


| 107 il 


5.5 


! April 15-May 31 


:|848 if 126 if 


i 173-2801! 


3. 0-4.9 


March 15-May 31 


|j 1,439 ! 


280 j[ 


5.1 



Without a breakdown by individual, we cannot know the overlap between the 107 users in the 
first month (information obtained in an early analysis) and the 280 users over the whole period. 
We do know that the mean hits per user decreased from 5.5 in the first month to 5.1 for the 
whole period. 

Comparing the number of hits on each book category for the two periods of data gathering, we 
find: 



Table 24. Hits by Book Category, March 15 - May 31, 1997 





March 15 - April 14 


April 15 - May 31 


Book Category j 


Hits 1 


i % of All 1 
Hits •! 


i Mean 
Hits/Wk 


1 Hits j 


% of All 
! Hits 


1 Mean 
!! Hits/Wk 


Garland i| 


24' j 


4% j| 


\5~6 


183 


10% 


|l2’ 4 


Granger's !j 


|na 1 


NA ;| 


NA 


[NA : 


NA : 


[na i 


OED*’ j] 


|70 ; . J 


12% 


1 16.3 


|4 17 


150% 


162.1 


Past Masters 


194 


46% ” l| 


2L9 


[31 


4% ||4.6 


Oxford Univ. Press j] 


|34 


16% ij 


[7.9 


[76 


9% 


111 3 


Columbia Univ. 
Press 


369 


62% 


86.1 


1228 

! 


27% 


[34.0 

if 


TOTAL 


591 


1100% 


! 137.9 


|835 


100% 


1 124.4 



The OED was added late in the first period. One means of access for The 
OED is still not included. 



As The OED came into the user-based analysis late, it had an artificially low number of hits and 
share of the total in the first period. As a result, the shares for the other book categories were 
inflated. In the second period, The OED has the prominence among the online books - a 50 
percent share of hits - that the other server data have shown, even though one means of access 
is not included. 



During the second period, use of the three Garland reference books doubled to an average of 
four hits per week per book and hits on the Oxford monographs increased 43 percent. Weekly 



O 

ERIC 

17UUI sbi&mj 

1 / vi 



12/1/97 1:12 PM 






AKL's Scholarly Communication and Technology Project 



http://www.arl.org/scomm/scat/summertield4.html 



hits on the Past Masters decreased 79 percent and on the Columbia monographs 60 percent. 
Overall, average weekly hits were down ten percent. 



4.3.4.2 Use Concentration 

In this section we will analyze the data on the number of users, the amount of use per user, and 
the demographics of the user population for the various books. This analysis may shed light on 
the patterns of use and what factors favor use of online books. 



4.3.4.2.1 Reference Books 

The number of unique users, hits and mean hits per user for each of the reference titles for 
which data are available during this period was as the following table shows: 

Table 25. Unique Users and Hits for Reference Books, March 15 - May 31, 1997 



[Title 

\ 


\ Users i 


Hits 


Mean i| 
i Hits/User] 


Whe OED 


[l73 


487 


IZ8 ll 


‘{Chaucer Name 
{Dictionary 


[9 


34 


b.8 | 


L Native American 
‘{Women 


I 9 


39 


U.3 | 

\ \\ 


African American 
Women 


I 6 


33 


i i 

|5.5 j| 



These data show an inverse correlation between number of users and the mean number of hits 
per user. 



4.3. 4.2.2 Non-Reference Books 

Half of the 82 online non-reference texts, including the Past Masters, were used during this 1 1 
week period. The distribution of titles by number of users was as follows: 

Table 26. Non-Reference Books by Number of Users, March 15 - May 31, 1997 
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| Number! 


j Number 


j Share of 


| of Users j 


j of Titles 


j Titles 


130 


in'.. 


|l% 


|18 | 


[1 


> 

i : 

\ : 


18 ] 


5 


p 

|2% 


(7 H 


[2 


(2% j 


!6 


ET* 


|4% _ J 


(5 1 


jo ~ 


0 ; 


j4 


I 4 


p% ] 


|3 | 


(3 


u% ] 


! 2 


' ' 


i' 1 ' 2 % j 


ji | 


|15 ; 


f 18% 1 


jo 1 


|41 


|50% | 



In declining order of number of users, the non-reference texts which had two or more unique 
users during this period, their number of users, number of hits, and mean hits per user were: 

Table 27. Unique Users and Hits for Non-Reference Books, March 15 - May 31, 1997 
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1 Title 


Users 


Hits 


Mean 

Hits/User | 


jj Task Strategies: An Empirical 
'Approach to Clinical Social Work 


30 


288 | 


9.6 J 


\Mutual Aid Groups, Vulnerable 
ii Populations and the Life Cycle 


18 


138 


1.1 j 


ii Philosophical Foundations of Social] 
| Work 1 


8 


I 21 i 


2.6 1 


Supervision in Social Work 


*[77717] 


[33 | 


4.1 | 


Self Expressions: Mind, Morals and j 
i| the Meaning of Life i 


1 


21 


3.0 J 


ii Bangs, Crunches, Whimpers, & 
Shrieks ii 


7 


! 21 | 


3.0 |] 


ii Handbook of Gerontological Services ii 


6 


[31 3 


5.2 J 


ii Qualitative Research in Social Work |6 


|10 1 


1.7 | 


i| Turning Promises into Performance: ii 
The Management Challenge 


6 


|31 ! 


5.2 ] 


\Gender in International Relations 


fZZZZZ! 




1.5 | 


\Other Minds 


4 


|34 _J| 


PTIZjI 


\Seismosaurus 


PT77Z71 


i 8 ~r m 


2 j 6 '"' 711 


The Prince 


EZ 777 


|12 H 


777177] 


iNietzshe's System 




liCZZZji 


[ 2 I 0 7 || 


'{The Logic of Reliable Inquiry 




wzillj 


2.3 | 1 


fThe New Organon 


3 i 


|24 1 


70 i 


Art of Rhetoric 


2 | 


18 I| 


4X) 1 


An Essay toward a New Theory of 
ii Vision 


2 


| 2 


|l.O J 


ii Federalist Papers 


[2 


|9 


[4.5 | 


ii Free Public Reason: Making It Up 
jjAy We Go.. 


1 2 


i 6 


I 3 - 0 1! 


On the Principles of Political 
ii Economy ... 


I 2 


|6 


I 3 - 0 


ii Philosophy of Mathematics & Math. 
^Practice in the 17th Century 


\2 


|3 


ji.s 1 


ij Principles of the Most Ancient & 
\Modern Philosophy 


1 2 


I 8 


ko ] 




\2 i 


£ : 


ITi 11 


ii Reflections on the Revolution in 
| France 


I 2 


j 5 


I 2 - 5 1 


iSedimentographica 


£ 


16 


Eo 1 


iiNote: Titles in bold were on reserve for one or more courses in Spring 1997. 
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The two books with the most users, both social work texts, had the most hits and the first and 
fourth highest mean hits per user. They accounted for 426 (51%) of the 832 hits on 
non-reference texts during this period. The top four texts (five percent of the non-reference 
collection), all social work books, accounted for almost 58 percent of the non-reference hits. 
The mean hits per user are highly variable. Only six texts averaged more than five hits per user. 



4.3.4.3 User Cohorts 
4.3.4.3.1 Reference Books 

The top user departments and Columbia statuses for the reference books are as follows: 



4.3.4.3.1.1 The OED 

The seven departments that were the source of four percent or more of the users were: 



iDepartment 


User ij Hits ij 
Share |j Share | 


Columbia College 


21% ill 8% || 


jUnidentified User ;i 

:!(Bamard, Teachers ij 

HCollege) i I 


15% ||l6% | 


i English ! 


|9% ||i3% II 


iEngineering 


18% Il8% | 


Computer Science 


|6% |9% ij 


| General Studies 


4% U% ij 


jHistory 


|4% p%' J 


Total 


673)0% |7()i()0% 



Primary Columbia statuses that were the source of four percent or more of the users were: 



^Columbia Status 


User j Hits 1 
Share 1 Share | 


| Undergraduate Student 


|58% 155% I 


^Unidentified User 


75% 1 16% ij 


j Graduate Student 


6% 11% j 


) Professional Student 


4% |4% j 


i Total 


83% |86% j 



Faculty were responsible for a total of less than three percent of the hits on The OED. 
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4.3. 4.3. 1.2 Grangers Reference Works: 

4.3.4.3.1.2.1 Chaucer Name Dictionary 

The distribution of the nine unique users by department is: 



r ~ ' " ' 

i 

j Department 


jj Number 
li of Users 


i Share of| 
| Users | 


Unidentified User 


il 2 


| 22% i 


1 Engineering 


| 2 


[ 22% 1 


i Columbia College 


1 1 


1 i!% | 


iEnghsh 


;| 1 


! n% 


IHistory 


:i 1 


1 n% ;l 


iMusic 


~lf 1 1 


r'7i%Hi 


i General Studies 


Hi T~ 


1 11% I 



The distribution of the nine unique users by primary Columbia status is: 



Undergraduate Student 


167%]! 


jUnidentiiied User 


|22% i 


:|Associate Professor | 


ul% ! 



4.3.4.3. 1.2.2 Native American Women 

The distribution of the nine unique users by department is: 



joepartment 


Number of |j 
Users 


Share of 
Users ;j 


jUnidentified User 


4 


44% 


jColumbia College 




11% j 


{Genetics 


1 1 


! u% ;| 


{Library Systems 


1 


11% 


{Social Work 


1 


11% ] 


p'Q» * 


T 


11% 



* To be identified 



The distribution of the nine unique users by primary Columbia status is: 
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i Unidentified User 


j[44%] 


[Undergraduate Student 


f'22%] 


jGraduate Student 


j[22%] 


[Catchall Other 





4.3.4.3.1.2.3 African American Women 

The distribution of the six unique users by department is: 



f : 

| Department 

> ! 


Number 
of Users 


Share of 
Users 


[Unidentified User 


3 


50% 


i Electrical Engineering 


! 1 


"l7% 


jGenetics 


! 1 


17%™' 


1 English 


[ 1 





The distribution of the six unique users by primary Columbia status is: 



[Graduate Student 


l33%1 


[Undergraduate Student 


|l7%l 


[Unidentified User 


| : 50% =j 



4.3.4.3.2 Non-Reference Books 

Almost 91 percent of the users of the top four books, all social work titles, were from the 
School of Social Work; they accounted for 98 percent of the hits on those books. The vast 
majority of these users (56 of 64) were graduate students. With the exception of the most used 
one, Task Strategies, these books were on reserve for social work courses during the spring 
1997 semester. 

• Three sections, with a total of about 70 students, used Supervision in Social Work as a 
key text. Thus, potentially, if all seven graduate student users were members of these 
course sections, about 10 percent of the students used this book online during this half 
semester. 

• A different three sections, again with about 70 students in total, used Mutual Aid Groups. 
This book was a major reading in the course; in fact, one of its authors taught two of the 
sections of the course in which it was used. Sixteen graduate students used this title for a 
potential penetration of about 23 percent. 

• Philosophical Foundations... (as well as Qualitative Research in Social Work ) was on 
reserve for a doctoral seminar which had an enrollment of 1 1 students. The instructor 
reported that this book was a major text in the course that students would have bought 
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traditionally. She did not know how many of her students used the online version. If all 
eight graduate student (7) and professional student (1) users were class members, that 
suggests a substantial penetration for that small class. However, it is likely that some of 
these users were not enrolled in that course. 

• We have no explanation for the heavy use of Task Strategies (by 26 graduate students). 
The instructor for the course in which the book had been assigned the previous semester 
reported that she had not recommended it to her students. 

The fifth and sixth most used titles - Self Expressions: Mind, Morals and the Meaning of Life 
and Bangs, Crunches, Whimpers, & Shrieks - are both Oxford University Press philosophy 
titles. 



• Self Expressions is listed in the Current Social Science Web page along with the social 
work titles. Five of its seven users were from the School of Social Work, one from the 
Center for Neurobiology and Behavior, and one from Electrical Engineering. Five of the 
users were graduate students, one an undergraduate student, and one a post doctoral 
research fellow. 

• Bangs, Crunches, Whimpers, & Shrieks is listed under Physics in the Current Science 
Web page. Two of its seven users were from the Physics department, another two from 
unidentified departments, and one each from Electrical Engineering, Engineering and 
General Studies. Five of the users were undergraduate students and two unidentified 
status. 

Looking at the various non-reference collections overall, we find the following cohort 
dominance patterns: 



4.3.4.3.2.1 Past Masters 

The departments with four percent or more of the 125 hits on Past Masters were: 



[Department 


[ Hits 


[[ Share of Hits 


[Economics 


<29 


]!23% 


[Anthropology 


[l6 


Il3% i 


[Political Science 


&..ZZI 


if 13% f 

: 


[Visual Arts 


fl3 


i|lO% 


[Unidentified 


[To 


(8% 


[History 


|8 


|6% 


[Columbia College 


EZZI 


][6% [ 


[English & Comparative 
[Literature 


I 7 


[6% 


[Physics 


\~5 


[4% i 


[Total 


jni 


[89% " i 


[Note: Detail may not sum to total due to rounding. 
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The Columbia statuses with four percent or more of the hits on Past Masters were: 



1 Columbia Status 


| ’ Hits 


Share of Hits 


Undergraduate Student 


186 II 


169% 


| Graduate Student 


:p : s 


9% 


Unidentified 


!|io 1 


8% 


I Total 


|| 107 


86% 


|Note: Detail may not sum to total due to rounding. 



4.3.4.3.2.2 Columbia University Press 

The departments with four percent or more of the 597 hits on the Columbia University Press 
texts were: 



|Department 


Hits 


ji Share of Hits j 


j Social Work 


!|547 


192% i| 


Unidentified 


|(28 


|5% l| 


jTotal 


=575 


|96% | 



|Note: Detail may not sum to total due to rounding. 



The Columbia statuses with four percent or more of the hits on these texts were: 



I Columbia Status 


|| Hits 


i| Share of Hits 


i Graduate Student 


1525 


1(88% 


Unidentified 


||28 


|5% 


jFaculty (Professor-Lecturer) 


l(23 


|(4% 


I Total 


[576 


196% 


|Note: Detail may not sum to 


total due to rounding. 



4.3.4.3.2.3 Oxford University Press 

The departments with four percent or more of the 1 10 hits on the Oxford University Press texts 
were: 
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i Department 




1 Share of Hits i 


[International & Public Affairs |i 


|26 7ZI 


\ 24 % j 


1 Social Work 


|21 


f 19% 1 


| Engineering 


jio 


19% 1 


jPolitical Science 




|7% Z 


1 Unidentified 


is:: 


|7% ] 


| Physics 


5 


|4% 


lLamont-Doherty Observatory 


|5 


;4% 


| Total 


|83 


|75% 


jNote: Detail may not sum to total due to rounding. 



The Columbia statuses with four percent or more of the hits on these texts were: 



| Columbia Status j| Hits 


Share of Hits : 


j Undergraduate Student 1(35 


132% | 


[Graduate Student i|30 


1 27% 


[Professional Student i|26 


[24% | 


| Unidentified i|8 


7% i 


[GRA i|5 


[ 4 % 1 


! Total j 104 


[ 95 % 


[Note: Detail may not sum to total due to rounding. 



4.3.4.4 Online Book Use Per User 

The distribution of number of hits on the online books collection per user over this period 
indicates that while many users are making quite cursory use of the online books, more are 
looking at more than one file (e.g., reference entry, chapter) in the collection. 

Table 28. Distribution of Hits Per Unique User, March 15 - May 31, 1997 
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|No. Of 

jHits Per 
jUser 


;| % of Total j 
| Users | 


1 1 


j|34% j 


\2 


i|l6% | 


IF 


p% || 


|4 


|i% ll 


1 5 


]4% ] 


16-10 


I|l 6 % | 


Ill -15 


nii% I 


[IFF) 


1(5% ii 


[ 2 T- 25 ™ 


"1(2% 1 


|>25 


|j 2 % i 


IDetail may not sum to j 


i 100% due to rounding, j 



The distribution of number of unique titles viewed by these users over this period indicates that 
most users come to the collection to look at a single book. The greatest number of books used 
by a single person was seven (by two persons). 

Table 29. Distribution of Unique Titles Viewed Per User, March 15 - May 31, 1997 



;No. Of Titles 
IViewed Per 
;User 


ij Number of 
Users 


% of Total! 
Users 


r 1 


1225 1 


180% 


2 


132 


111% 


F” 


Ifii 


\ 4 % 1 


4 


l|8 ] 


[ 3 % I 


! 5 ” 


ill 


F%~ H 


r <5 


ifi j 


F% 1 


r 7 


||2 1 


ji% | 


Total 


If 280 1 


1100 % 1 


[Note: Detail may not sum to total due to j 
bounding. 

!* Less than 0.5% 



Not surprisingly, there is a certain correlation between number of hits and number of titles used. 
Those with only one hit could only have looked at one title (42 percent of those using one 
book). The range of hits among those who used only one book is wide - 20 (9 percent) had 
more than ten hits. Six users had more than 25 hits; two of them looked at only one book, one 
each at two and three books, and two at seven books. These statistics indicate some significant 
use of the collection as measured by average number of hits per title used. 
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However, hits on several titles need not indicate heavy use of the online books collection. The 
individual who looked at five books had a total of only six to ten hits as did four of the seven 
people who looked at four books (one to two hits each). The person who looked at six books 
had 1 1 to 15 hits in total (an average of about two hits per book). 

As the following table shows, graduate students tended to have more hits, undergraduates and 
faculty fewer hits. 

Table 30. Hits Per Unique User by Academic Cohort, March 15 - May 31, 1997 



Academic 


f'"-'" - 

| N= 

1. 


ij 1 Hit 


f 2-3 


J 4-5 


i 6-10 i 


fll-20 


ran 


ICohort 


! Hits 


|| Hits 


Hits 


I Hits 


1 Hits 


jUndergraduate 


IH4 


|40% 


[28% 


|13% 


i 14% 


[ 4 % ' " " 


fi% 1 


jGrad. Student 


166 


1 18% 


is*: 


' \9% 


20% 1 


[ 27 % 


][l2% ” 


jProfl Student 


( 9 


|33%j 


[ 22 %' 


|22% 


[ 11 %’j 


io%::: 


EMI! 


iFaculty 


i 12 

i 


(42% ; 


|25% 


1 17% 


8% | 


|8% 


16%'"' j 



These are highlights of the recent data on usage by individuals. Once we have the information 
on sessions, we will be able to derive valuable information on user behavior - not only number 
of books used and hits on those books but parts of the book used and repeat usership. We will 
begin to be able to see revealed preference in user behavior and will be less reliant on responses 
to questionnaires. 
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One of our principal goals is to understand what distinguishes users from non-users, early 
adopters from late adopters, and so on. We have tentatively identified several kinds of variables 
that might influence users with regard to adoption of electronic books. We can broadly divide 
these into: resource factors (discussed here), attitude factors (discussed in section 6), and 
behavior factors (discussed in section 7). 



5.1 Resource Factors 

We believe the key resource factor to be possession of, or easy access to, adequate computer 
equipment and connections, so that online books are a reasonable alternative to paper versions. 
As noted earlier in a discussion of early research results, we have two primary methods of 
studying this factor: 

1 . Asking the question about access to computers with network connections that was 
discussed earlier; and 

2. Developing a detailed profile of the computer resources available to representative 
samples of members of the Columbia community. As described earlier, we used the 
campus computing survey instrument in three sweeps through the community, in what we 
regard as pilot implementations in Fall 1995 and Winter 1996. The questionnaire asked 
respondents for detailed information about their computers. However, many respondents 
did not supply the requested data on computer power, size of hard drive, modem speed, 
and the like. Furthermore, observation of developments in the personal computer 
marketplace makes it clear that changes in personal computers will make the top of the 
original scales on these questionnaires the bottom of the scales in as little as two years. 

Section 7 contains further analyses of the first of these factors. 



5.2 Attitude Factors - In-Class Survey 

We cannot probe attitude factors easily in a simple survey, whether in paper or online. We have 
designed some questions aimed at assessing whether the respondent thinks that members of his 
peer group use and/or prefer electronic access to books and other resources. On the one hand, 
this perception of others' preferences might precede and shape a user's own preferences and 
behavior. Alternatively, if use of computer modalities is, as some psychological research 
suggests, a very private activity, awareness of the behavior of others may, in fact, lag the move 
to using online books. 



5.2.1 The In-Class Survey 

Examples of such results include the data from Fall 1996 and Spring 1997 in-class surveys of 
students who were assigned a reading that was available online for the session during which the 
survey was administered. Students who had done the reading were asked to answer questions 
about what forms of the book they used, how long they used that form, where they did that 
studying, format preference, reasons for it and impacts, expectations for format most used by 
classmates, and the two benchmark questions about computer access and time online. (See 
Exhibit 4.) Those who had not done the assignment were asked to respond only to the last three 



0 



AKJJs Scholarly Communication and Technology Project 



http ://www .arl. orgAscomm/scat/summertielcD .html 



questions. 



[Exhibit 4. Survey Of Book Use For Course Readings 


| As part of its effort to serve you better, the Libraries would like to know what 
[methods you used in reading an assignment for this class session. All responses 
[will be kept confidential. 


|A. Did you read the assignment in Kadushin's SUPERVISION IN SOCIAL 
[WORK for this class session? 

j l. YES (If so, please answer all the questions .) i. NO (If not, please 

\skip down and answer Questions F-I only.) 


B. Following is a list of methods that you might have used in doing this 
[reading. Please tell us about your use of each for this assignment. If you 
[used a method, please tell us for about how long you used it and where 
[you did this reading. 


[Methods of 
[Reading This 
[Assignment 


....................... ; 

Did you use 
it? (Please 
circle) 


For about how long? 
# Hours & # Minutes 


Where (e.g., 
library, dorm 
room, lounge, 
[classroom)? 


jl. Your own 
[copy of the 
[book 


ij 

1. YES 

2. NO 

i ■ i 




pv^vw.vrtv.w^w.v.. J 

[ l 

if 

1 1 


[ 2 . A friend's 
[copy of the 
[book 


1. YES 

2. NO 

! ii 






[3. A library 
[copy of the 
[book 


1. YES 

2. NO 

l • 1 




f 


|4. Photocopy 
[from paper copy:! 


[l.YES 

l2.NO 




\ : J 


\Using CWeb Online Text: 




if 


[5. Reading it 
[directly from 
[CWeb 


1. YES 

2. NO 

t :i 


■ ;j •{ 

i ;j if 


j<6. JAKE 
[printout of text 


1. YES 

2. NO 


| ij Ij : 


7. Printout using 
non- JAKE 
printer 


1. YES 

2. NO 


1 - J 

i : l 1 if 

i 1! 

\ !i :j 

i 


8. Download of 
online text to 
disk & reading 
[away from 
[CWeb 


j : 

\ : 

1. YES 

2. NO 


i I; if 

\ ii if \\ 

. ♦ . . . - 
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jc. If you used more than one method, which one did you like best? (Please 
(circle the number of the preferred method from the above table.) 1 2 3 4 5 6 7 j 



|D. Why did you like that method best? (Please circle the numbers of all the 
treasons that apply.) 

1. Less costly 2. Easy to get to 3. Easy to read 4. Always available 5. Easy to j 
jcopy 6. Easy to search for words or concepts 7. Easy to annotate/take notes 8. |f 
j Other reasons: 

|E. What were the impacts on your work of using the method you liked best? 
((Please circle the numbers of all that apply.) 1. 1 learned better. 2. 1 learned 
(faster. 3. Learning was more fun. 4. 1 was more likely to do the assignment. 5. jj 
^Reading the assignment was more difficult. 6. Doing the assignment was faster. 

|7. Doing the assignment was slower. 8. Other impacts: 

IF. Which of these methods of reading this assignment do you think was most 
(used by your classmates? (Please circle the number of the method from the 
jabove table.) 12345678 

G. Is there a computer connected to the campus network (by modem or direct 
|link) that you can use whenever you want? (Please circle.) 1. YES 2. NO 

H. About how many hours per week do you spend in each of the following 
(online activities? 

j Email Listservs and Newsgroups CLIO Plus 

Scholarly Text, Image or Numeric Data Sources Other 

jWWWeb | 

j/. Your insights into your experience and preferences in using various book 
[formats are valuable: .1 



\Thank you for your assistance with this study. 



Form 8, 9/96: Distribution Date: 4/29/97 Course: SOCW T7134 



In Fall 1996, most of this surveying (67 percent of a total of 439 responses) was done in 
sections of Columbia College's Contemporary Civilization course for which some of the 
readings are available in the Past Masters set of humanities texts. However, those students are 
expected to use the assigned editions of the readings and to bring a copy to class for use during 
the discussion. This may well have biased students' choices in methods of reading the 
assignments. About 16 percent of the cases in the sample came from graduate Social Work 
classes and 17 percent from a large upper level undergraduate political theory class. 

In Spring 1997, the Contemporary Civilization course was the source of 106 (44 percent) of the 
239 respondents. Two political science courses, one undergraduate and one graduate level, 
were the source of another 17 respondents (7 percent). Four graduate Social Work courses 
were the source of the remaining 116 respondents (49 percent). 
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5.2.2 Methods of Studying A Class Reading 

Some students had not done the reading for the course session in which the surveying was done. 
Some others reported using more than one method. 

Table 31. Methods of Reading This Assignment: Whole Sample Fall 1996 And Spring 

1997 



[ Fall 1996 


| Spring 1997 


jMethods of Reading 
jThis Assignment 


I Count 1 

i 


1 % of 

| Responses 


j Count 


| % Of : 

Responses 


iUsed Own Copy 


1269 


[70% 


[l41 


[73% ! 


iUsed Friend's Copy 


154 


U4% 


|20 


fio% ! 


IUsed Library Copy 


133 1 


ji%~ 


fl7 


[9% 1 


iUsed Photocopy 


fTi 


(3% 


\nZZ 


19%™ 


|Reading it directly from 

icWeb 


1° 


|o% 


EL. 


0% 

\ 1 


i JAKE printout of text 


[To I 


w% 


= 16 


Wo : 


jPrintout using non-JAKE 
Iprinter 


14 

? 

1; 

|5 

i ^ 

> 


|i% 

|i% 


I 4 


f 

\2% 

l : 


IDownload of online text to 
Idisk & reading away from 
iCWeb 


1 

\ 

\ 


J 

\*% 


i Total 


[386 


flOO% 


|216 


iioo% n 



This table shows that, in Fall 1996, 70 percent of the responses reported using one's own copy 
of the text. The next most common method was to use a friend's copy (14%). The shares for 
those two modes are insignificantly different in Spring 1997. 

The questionnaire gives four alternative means of Using CWeb Online Text: 

Reading it directly from CWeb 

JAKE printout of text 

Printout using non- JAKE printer 

Download of online text to disk & reading away from CWeb 

In Fall 1996, there were 19 reports (5 percent) of printing out or downloading from the CWeb 
books, but none of reading directly from CWeb. In 89 percent of those cases, the respondent 
was not in a Contemporary Civilization class. In Spring 1997, about 1 1 percent of responses 
reported using some form of the online text, but again none reported reading on screen. 
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There were far fewer responses (1 19 in Fall 1996 and 88 in Spring 1997) as to the preferred 
mode of studying. In both semesters about two thirds of respondents reported that reading their 
own copy was preferred. 

Table 32. Preferred Method Reading This Assignment: Whole Sample Fall 1996 and 

Spring 1997 



Fall 1996 Spring 1997 



[Preferred Method of 
I Reading Assignment 


Count 


% of Cases;! 


Count 


% of Cases j 


(Own Copy 


[83 | 


67% ; 


156 || 


64% | 


[Friend's Copy 


[9 [ 


8% ' j 




i^ZZZZI 


i Library Copy 


Bo il 


8% i 


6 [| 


7% ;| 


[Photocopy 


[7 ii 


[6% 


18 i 


9% :[ 


[Reading it directly from 
jCWeb 


II 2 


2% 


7 || 


8% i| 


[JAKE printout of text 


IFZZj! 


wziij 


iZII'ZZj 




[Printout using non-JAKE 
[printer 


J 3 


2% 


5 i 


i i 

6% 


[Download of online text 
[to disk & reading away 
[from CWeb 


I 3 


2% 


1 i 


r Zi 

[ 1 


[Total Responses [124 


[101% 


[95 


[109% ; 


[Total Cases Responding [119 


88 | 



(Note: Detail may not sum to 100% due to rounding. 



5.2.4 Reasons for Preference 

As the following table shows, in both semesters, the three strongest reasons for preference were 
always available, easy to annotate, and easy to read, with the last two reasons switching 
position between the semesters. 

Table 33. Reason for Preferred Method: Whole Sample Fall 1996 and Spring 1997 



?EST COPY AVAILABLE 
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1 Fall 1996 | 


Spring 1997 


1 Reasons for 
| Preference 


jj Count 


% of Cases) 


Count j| % of Cases 


jLess Costly 


160 ' I 


22% ] 


33 


1123% 

:: : 


jEasy to get to 


rilIZZI 


o% ii 


6 


lo% 


■Easy to Read 


:j 104 


138% j| 


170 


i|48% 


[Always Available 


j| 199 


172% j| 


108 


|74% 


jEasy to Copy 


|21 1 


8% 1 


120 " 


ii 14 % i 


jEasy to Search for 
jWords 


i 30 I 


11 % i 

L ........... .......j! 


fr 


|io% 

: 1 ... - ... . ..................... ................ .: 


jEasy to Annotate 


j 135 ji 


49% 1 


[57 


139% 1 

:j : 


[Other Reasons 




9% ~ 3Z1 


16 


Jll% ] 


j Total Responses 


1574 | 


1209% i 


319 


219% 


[Total Cases 
j Responding 


276 




146 



|Note: Respondents could give more than one reason for their preference. 



At present, these attributes are possessed only by a personal copy or photocopies from print 
copies or printouts from electronic copies. (Online books are always available, but one assumes 
that ready physical access to a computer does not meet the criterion always as students 
interpreted it here.) 

The cross-tabulation of preferred method of use and reasons for that preference produces 
logically consistent results. For example, all of the respondents who gave Printout using 
non- JAKE printer or Download of online text to disk and reading away from CWeb as their 
preferred method gave less costly as one of their reasons while few of the those preferring their 
own copy gave that reason. 

Table 34. Preferred Method & Reason for Preferred Method: Whole Sample Spring 1997 

- Row Percentages 
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Reason for Preference 



| Preferred 
[Method 


Less : 
Costly 


Easy toll Always 1 
Read [Availabh 


| Easy to ! Easy to 
| Copy |j Search 


| Easy to 
Annotate 


[ Other 


[Own Copy 


|8% 


47% |83% 


[7% 19% 


<41% 1 

i ’ 1 


|ii% 


[Friend's Copy 


|75% 1 


25% "][75% 


[o% 1o% 


[25% 


0 % 


[Library Copy 


125% ; 


25% i|50% 


]25% |25% 


lo% 1 


125% 


[Photocopy 


|50% 1 


150% |33% 


<33% |o% 


1 17% j| 


io% 


lOnCWeb 


[60% || 


120% |80% 


<20% 140% 


o% || 


|o% 


1JAKE Printout 


[ 50 % i| 


167% :|83% ' 


[83% 10% 


|17% i| 


lo% 


[Other Printout 


|100% :j 


[20% [60% ' 


<60%' 120% 


[20% 1 


io% 


[Download to 
[Disk 


|100% ;| 


0% 1 100% 


|ioo% |o% 


1 

M 

i ® [ 


0% 


[Total 


|24% | 


144% :|75% 


[l6% 112% 


133% 


;9% 



[[Note: Easy to Get To was another reason offered but no one chose it in either 
[semester. 



So we have a consistent picture of what makes a mode good, preferred, and used. In other 
words, our student respondents are behaving rationally. 



5.2.5 Impact of Preferred Method 

As the following table shows, when asked what the impact of the various possible modes was, a 
majority of the students selected more likely to do the assignment. Learned better and doing 
assignment faster ranked second and third, being cited by about one third of the students. 

Table 35. Nature of Impact of Preferred Method: Whole Sample Fall 1996 and Spring 

1997 
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| Fall 1996 


Spring 1997 


Impact of Preferred 
Method 


Count 


i % of Cases 


Count [j % of Cases 


jLeamed Better 


|92 


[|34% 


;51 


|34% 


[Learned Faster 


|51 


[|19% 


[27 


||l 8% 


[Learning More Fun 


1 16 


|6% 


fl3 


||9% 1 


[More Likely To Do 
[Assignment 


|;i54 


|57% 


|82 


|54% 


[Reading More Difficult 


|8 


|3% 


|l 


|i% i 


[Doing Assignment Faster 


fair 


E\% 


[56 


(37% J 


[Doing Assignment Slower 


|l2 


|4% 


|2 


ZmZZl 


[Other Impacts 


129 


|11% 


121 


|14% 


i Total Responses 


|447 


jl65% 


1253" 


! 168% [ 


[Total Cases Responding 


[[271 




|l52 


[Note: Detail may not sum to 100% due to rounding. 



These are again entirely rational bases for preferring some particular mode, when we note that a 
student's role is to get assignments done and to learn. 



5.2.6 Comparison of Personal Behavior and Perception of Others' Behavior 

Students were asked what method they thought most of their classmates used in order to learn 
whether they perceived a shift to using the online materials. In Fall 1996, 81 percent of 
respondents chose own copy, and 14 percent chose library copy. In Spring 1997, these values 
were 80 percent and eight percent, respectively. This contrasts with the reality that 70 percent 
(73 percent in Spring 1997) used their own copies, 14 percent (ten percent) used a friend's copy 
and eight percent (nine percent) used a library copy. 

Interestingly, while none of the respondents had used the CWeb book directly to do this 
assignment, in both survey periods almost two percent (five or six students) gave that response 
to this question. In the fall, another nine students (two percent) and, in the spring, another 13 
students (six percent) thought that their classmates had used some form of print copy or 
downloaded file from CWeb. Thus, students are over-estimating their colleagues' propensity to 
read directly from CWeb and under-estimating their propensity to read printed copy and 
downloaded files from CWeb. 

Table 36. In-Class Surveys: Personal Behavior and Perception of Methods Used by 
Classmates to Read This Assignment: Whole Sample Fall 1996 and Spring 1997 
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j Fall 1996 


| Spring 1997 


\Methods of Reading 
| This Assignment 


} 

Own 

Behavior 


Perception 
of Others' 1 
Behavior 


1 :i 

I Own 

| Behavior 


Perception 1 
of Others' 1 
Behavior 1 


jUsed Own Copy 


(74% 


81% : 


173% 


80% 


jUsed Friend's Copy 


1 15% 


1 % 


[ 16 % 


4% j 


iUsed Library Copy 


] 9 % 


14% 


\ 9 % j 


8% 1 


jUsed Photocopy 


|3% 


4% 


|9% ;i 


7% 


1C Web Directly 


fo%: 


2 %" 


io%::::D 


2 %' ’ ] 


(Used JAKE Print 

jcopy 1 


|3% 


i% 


18% 

jj :i 


5% 


IUsed Other Print 

[Copy 


|l% 


*% 


= 2% 

1. 


1 % 


IUsed Download 
iCopy 


1% 


i% 


i 

!*% j 


*% 


|Note: * Less than .5%. 



At the present time, there is not sufficient penetration of the market by the online modes for us 
to draw any meaningful conclusions about leading and lagging impacts. Results of this survey in 
Fall 1997, particularly in Social Work classes, should give some indication of trends as students 
will have had more time in which to gain awareness of the availability and attributes of the 
online format. 
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6.1 The Online Interview Instrument 

The online instrument is mounted as an HTML form. The key questions are presented here 
along with an example of the pull down list that accompanies one of the questions. Exhibit 5. 
Online Survey Instrument: Non-Reference Books 



\A. What is the title of the book you just used? 



\B. Please select the best description of that work or project for which you are using this book. If 
:j "Other", please specify: 



l = 'Research project, e.g., paper, book' 
2=' Class preparation 1 
3='Current awareness infield ' 

4= 'Other University activity' 

5= 'Other: 



\C. How long ago did you recognize the need to consult this book for this use? 

\ 

[weeks / 

\D. How soon do you expect to make use of what you get from this book? 

ij [weeks / 

\\ 

■\ 

\ 

\ 

i 

| E. What did you do with this book on this occasion? (Select all applicable uses.): 

.1 

i 

| Looked up something etc. 



IF. Which forms of this book have you ever used? ( Select all that apply by checking the check boxes 
\ in the left column [Used] below.) If you have used this book in more than one way, which one do 
I you prefer overall? (Select one of the 'radio' buttons in the right column [Prefer] below.).... 



3 
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|G. Referring to the way of using this book that you prefer, why do you like it best? ( Select all that 

\ apply.).... 
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\H. On how many occasions (including this one) have you used this book in any format during the 
| last 3 months? 



\I. For approximately how many minutes in total have you used this book during the last 3 months? 

Is 

\J. About how many times in the past 12 months have you used an online book, i.e., a monograph or 
I reference book available on CNet or another computer network? times. 

\ \K. In the type of work you are doing now, do you find that paper books or online books help you to 
I be more productive? 

I L. Do you find that you are able to produce results of higher quality when you use paper books or 
j online books? 

| M. Is there a computer attached to the campus network (by modem or direct link) that you can use 
^whenever you want? Yes /No (*) 

\N. About how many hours per week do you spend in each of the following online activities? 

\ Email: Listservs & Newsgroups: CLIO -Plus: 



Text/Image/Numeric Data Sources on WWW: Other WWW: 




\0. What is your present primary relationship to Columbia? 



l[ Undergraduate / If "Other”, please specify: 



\P. What is your primary discipline ? 



\[ Undetermined / If "Other", please specify: 




3 



O 



ERIC 

or 



We initially launched the Web questionnaire in two parts. The reader was given the initial part, 
which asked questions that could be answered before he used the book, e.g., about his reason 
for using the book, timing of need for the material he was seeking, and his status, when he 
clicked on the title of the book. He was not required to complete it in order to move on to the 
book, but it was easy to respond at least in part. The scholar was asked to click on the button 
taking him to the second part when he finished his session with the book; it asked various 
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questions auout now ne ieit auout me online lormai. we eouiu not lorce me user to go to me 
second questionnaire and hardly anyone did. At the same time, the online book designers found 
working with two questionnaires to be difficult. 

In preparation for the Fall 1996 semester, we switched to a single questionnaire format in which 
the scholar must choose to go to the questionnaire after he uses the book. Response rates have 
been poor with fewer than ten questionnaires submitted in any week and many of those 
responses incomplete. 

Data captured from the questionnaires are processed (using Unix utilities) to produce a standard 
data file for input into SAS or SPSS. Findings from the most recent data are summarized below. 



6.2 Early Results from CWeb Survey 

6.2.1 CWeb Survey Responses by Online Text Used 

From late September 1996 through early June 1997, we received 85 responses to the CWeb 
questionnaire. 

Table 37. CWeb Online Survey Responses by Online Text Used, September 1996 - 

June 1997 



[Online Text Used 




l Coun ' Total 


[Oxford English Dictionary 


|64 ||75% 


[[Granger's Index to Poetry 


|l i|l % 


[[Garland Reference Works 


\2 i|2% 


Wast Masters Texts 


|8 [19% 


[[CUP Social Work 


\l [|8% 


[[Other CUP Monographs 


[6 iio% 


[OUP Monographs 


\2 i[2% 



The OED is both the most used of the online books and the one for which the most survey 
responses were returned. 

Given The OED's overwhelming presence in the responses, this analysis is largely one of 
reactions to the online OED. In a few cases the analysis distinguishes between The OED and all 
of the other texts. 



6.2.2 CWeb Survey: Primary Project for Using Book 

The questionnaire asked the scholar to select the best description of that work or project for 
which you are using this book and gave a choice of five options. The distribution of responses 
was: 



O 

ERIC 



Tahlp PWpIi Onlinp Siirvpv Rpcnnncpc hv WnrE TnvnlvpH Spnfpmhpr 1 QQ6 - 



SO 



12/1/97 1:36 PM 



AKC's Scholarly Communication and Technology Troject 



http://www.arl.org/scomm/scat/summerlield6.html 



June 1997 



[Work/Project 


% of Responses 


I Research project 


46% 


[Class preparation 




[Current awareness 


6% 


^Other University 
[activity 


5% 


[Other 


15% 



Research projects are the major purpose for using the online books. 



6.2.3 CWeb Survey: Ways of Using Book 

The questionnaire asks What did you do with this hook on this occasion? (Select all applicable 
uses.) It offers different reasons for the monographs and for the various reference books. 

For the OED responses, the distribution of book uses was: 

Table 39. CWeb Online Survey Responses: Uses of The OED , September 1996 - 

June 1997 



fuse 


;[%of OED | 


[Responses ii 


1 Definitions 


j94% 1 


j Etymology 


1143% Ij 


iiPronunciation 


ljl4% 1 


[History of words 


:|44% 1 


:i Examples of Use 


” 136 % | 


[[Citations for authors 


lfl3% | 


[[Citations for eras 


: |2i% Hj 



For all the other books, the distribution of uses was: 

Table 40. CWeb Online Survey Responses: Uses of Other Books, September 1996 - 

June 1997 



Use 

1 ii 


% of Other | 

Responses [| 


[Looked up something j 


[32% | 


[Searched for 


[47% j 


[something 


[Looked at citations 


[16% | 
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jLooked at table of [L 1fl - 

[contents &/or index ;; 

jLooked at introduction l 26% 
j[&/or conclusions j| 

jLooked at graphics ij 1 6% 

[Read part of the book [68% 



Those who reported that they used the online book by reading part of it were asked how much 
they read. Responses were distributed as follows: 



[[Less than 10% 


159% j 


jio-30% 


i i8% ]| 


[Over 30% 


j23% 1 



The majority of these online book users read less than 10 percent, say one chapter, online. 



6.2.4 CWeb Survey: Forms of This Book Ever Used 

The questionnaire asks Which forms of this book have you ever used? and offers the scholar 
nine options. Responses were distributed as follows: 

Table 41. CWeb Online Survey Responses: Forms of the Book Ever Used, 

September 1996 - June 1997 



[Forms Ever Used 

} :i 

\ 


% of OED 
Responses 
(N=60) 


| % of | 

[1 Other j 
! Responses 
] (N=17) 


[Online copy in library 


43%” 


If 12% [ 


[Online copy elsewhere 


53% 


j59% ” j 


[Printout from online 
[copy 


25% 


[29% j 

\ * | 


[Download from online 


13% 


12% j 


[Library paper copy 


60% 


3 12% j 


[My own paper copy 


30% 


|24% [j 


[Colleague's paper copy ;j 


[13% 


[12% 


[Photocopy from paper 
[copy 


[10% 


0% 


[CD-ROM 


[12% 


[6% | 
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For The OED , paper copy in the library received the most mentions with online copy elsewhere 
coming in a close second. For the other books, online copy elsewhere was the dominant 
response. 
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6.2.5 CWeb Survey: Preferred Form of This Book 

The questionnaire asked If you have used this book in more than one way, which one do you 
prefer overall? The same choices were offered as above. Responses (56 for The OED and 17 
for the other books) were distributed as follows: 

Table 42. CWeb Online Survey Responses: Preferred Book Form, September 1996 - 

June 1997 



i Preferred Form 

l jj 

If i! 


! % of OED 
Responses 


1 %of i| 

Other j 
| Responses j 


| Online copy in library 


21% 


:|l2% j 


lOnline copy elsewhere 


46% 


|24% ! 


[Printout from online 

: :: 

loopy 


12% 


;|24% | 


j Download from online 


2% 


1(6% 1 


j Library paper copy 


9% 


;|o% | 


{My own paper copy 


;5% 


||35% j 


i Col league's paper copy 


!o% 


;!()% fl 


i Photocopy from paper 
! copy 


0% 


|o% | 


JCD-ROM 


:4% 


|o% || 



Online copy used outside the library is far the preferred book form for The OED with more 
than twice the votes as the next most preferred form, online copy used in the library. Printout 
from online copy ranked third. The various forms of using the online OED received over 80 
percent of the preferences votes. 

The responses for the other books are also revealing. Just over a third of respondents preferred 
my own paper copy. Given the attributes ranked as important - always available and easily 
annotated, this is a logical top runner for non-reference books. However, various forms of using 
the online book received all the other votes of this small sample of users of the online book 
collection. 



6.2.6 CWeb Survey: Reasons for Preference 

The questionnaire asked Referring to the way of using this book that you prefer, why do you 
like it best? (Select all that apply.) Responses were distributed among the options offered as 
follows: 

Table 43. CWeb Online Survey Responses: Reasons for Book Form Preference, 

September 1996 - June 1997 
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li 1 

i Reasons for Preference ii 

i i 


% of OED ; ^ ° f 1 

j ~ \\ Other 

i Responses -s n 

r j Responses | 


|Less costly 


41% 160% ]| 


[Easy to get to 


|71% fl5% ji 


[Easy to read 


49% * 140% | 


I Always available 


66% 75% | 


[[Easy to search 


73% j40% 1 


iiEasy to copy 


144% i|30% !| 


jEasy to take 
jnotes/annotate 


20% 30% j 


j Other reasons 


8% :5% ~H| 



Easy to get to, which had no mentions in the in-class survey, was the most popular response 
given in this survey. In part this reflects the heavy presence of The OED in this survey, but this 
reason for the preference also tied with always available for the other responses involving 
books other than The OED. 



6.2.7 CWeb Survey: Preferred Format and Reasons for Preference 

Looking at all the responses, the top reasons for each format being preferred were: 

Table 44. CWeb Online Survey Responses: Preferred Book Form and Key Reasons for 

Preference, September 1996 - June 1997 



Preferred Form iKey Reasons for Form Preference 


jOnline copy in library [[Easy to get to 


Easy to search 


jOnline copy elsewhere iiEasy to get to 


Always available 


iPrintout from online L t , , 

* is Always available 

jcopy j! J 

: :» 

i ii 


Less costly 
Easy to get to 
Easy to copy 


[Download from online ijOne mention for all but Easy to read 


j ijEasy to get to 

[Library paper copy jj 

j ij Always available 


Easy to read 
jEasy to search 


[My own paper copy [Always available 


[Easy to read 


[Colleague's paper copy |Not preferred 


[Photocopy from paper | No , refelred 
icopy ;i 1 


[CD-ROM [[Easy to search 


[Easy to copy 
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The popularity of easy to get to is consistent with the preference for online copy used outside 
the library as long as the respondent has easy access to a computer with a Web browser. 



6.2.8 CWeb Survey: Frequency of Use in Past Three Months 

The questionnaire asked On how many occasions (including this one) have you used this book 
in any format during the last 3 months? The 79 responses were distributed as: 

Table 45. CWeb Online Survey Responses: Frequency of Use of This Book in Past three 

Months, September 1996 - June 1997 



1 Number of ij 


Number of; 


% of I 


1 Occasions 1 


Responses ij 


Responses;! 


fo || 


6 || 


8% ]j 


|T | 


16 


20% 


i H 


12 I 


15% | 


(5-4 


10 


13% 


|5-6 || 


10 


13% J 


,* * * I « • ! T« • • • « • « I * ! « I • * T. « • • # « * , 

[7-8 |1 


4 j| 


5% 


110-12 


19 I 


In* ; 


[15-19 Hi 


3 a 


4% 


; 20-35 !j 


6 1 


8% I 


150-99 ] 




4% 



Those responding ’zero’ were not following the directions to the question and presumably meant 
that this was their first occasion to use this book in this period. The mean was 8.7 occasions and 
the median 3.0 occasions - or an average of about three occasions per month based on the mean 
or once a month based on the median. It may be that heavy users of online books are more likely 
to notice our questionnaire and ultimately to respond and, hence, to be over-represented in this 
sample. However, the question asks about use in all formats. 



6.2.9 CWeb Survey: Total Usage in Minutes in Past Three Months 



The questionnaire asked For approximately how many minutes in total have you used this book 
during the last 3 months? The 79 responses were distributed as: 

Table 46. CWeb Online Survey Responses: Total Usage of This Book In Minutes in Past 

Three Months, September 1996 - June 1997 



O 

ERIC 



9 01 l J 



Minutes 


Number of 


li % of 


Responses 


ii Responses j 


0 


2 


||2% 


1-9 


13 


i 16% 


iiO 


[77 
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11U-IZ ;j 


10 


UV7o 


I 1 5- 1 8 


111 


114% 


1 20-24 


iio : 


;13% 


25-36 


15 


19% 


[ 45-60 


10 


13% 


ij80-90 


2 


|2% 



Again, those responding 'zero' were not following the directions to the question and presumably 
meant that they had not spent any time with this book previously in this period. The mean was 
22 minutes and the median 15 minutes. These are not great amounts of time for using a 
monograph but they are substantial for using a dictionary. 



6.2.10 CWeb Survey: Frequency of Use of Any Online Book in Past Year 

The questionnaire asked About how many times in the past 12 months have you used an online 
book, i.e., a monograph or reference book available on CNet or another computer network? 
The 75 responses were distributed as: 

Table 47. CWeb Online Survey Responses: Total Usage of Online Books In Past Year, 

September 1996 - June 1997 



Number of j 
Times 


Number of 
Responses 


% of 

Responses i 


: 

0 


10 


13% 


i-2 


18 


24% H 


3-6 


15 


20% 


10-16 ! 


8 


11% 


20-25 


9 


12% 


30-50 


12 


16% 


75-99 


3 1 


4% 



The mean was 15 uses in the past year and the median five uses. This sample is most likely not 
representative of all users of the on li ne books, let alone of the Columbia community. 



6.2.11 CWeb Survey: Effect of Online Books on Scholarly Work 

Two key questions asked on all of our questionnaires, other than those distributed in class, seek 
to determine the effect of online books on scholarly work. 




• In doing the type of work for which you used this book, do paper books or online books 
help you be more productive ! 

• Do you find that you are able to do work of higher quality when you use paper books or 
online books ? 
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The questionnaire offers a range of seven responses from Much greater productivity (quality) 
with paper through No Difference to Much greater productivity (quality) with online plus 
Cannot Say. 



6.2.11.1 CWeb Online Survey: Productivity, Book Type and Format 

As the following table shows, many OED users felt that they are more productive using the 
online OED works while only a modest number of the users of the other online books felt that 
they are more productive using online books. 

Table 48. CWeb Online Survey: In doing the type of work for which you used this book, do 
paper books or online books help you be more productive ? by Book, September 1996 - 

June 1997 



:j Response 


| OED (N=64) 


All Other 
| Books (N=21) !| 


.[Cannot Say 


[12% ;i 


io'% I! 


[Paper Much Greater 


i i6% 


24% j| 


[Paper Greater 


!8% :i 


14% 


[Paper Somewhat 
[Greater 


1 12% 


14% 1 


[No Difference 


[2% ) 


19% 


: Online Somewhat 
[Greater 


1 17% 


5% i! 

1 : 


[Online Greater 


j 17% 1 


[5% 1 


[Online Much Greater 


[16% 1 


io% 1 



[Note: Detail may not sum to 100% due to rounding. 



Of the group of 64 users of The OED, 50 percent believed that they were more productive with 
online books and 36 percent believed that they were more productive with print books. Only 
one respondent thought there was no difference and eight responded cannot say. The 21 users 
of the other books did not share this feeling. Only 19 percent believed that they were more 
productive with online books and 48 percent believed that they were more productive with print 
books. However, another 19 percent noted no difference in productivity and ten percent 
responded cannot say. 



6.2.11.2 CWeb Online Survey: Work Quality, Book Format and Type 

As the following table shows, the distribution of responses to the second question about the 
quality of work when using print and onl in e books supports the print format in general, although 
many respondents found no difference in their work quality with the two formats. 



Table 49. CWeb Online Survey: Do you find that you are able to do work of hi gher, quality 
when you use paper books or online books'! by Book, September 1996 - June 1997 
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\ 

j Response 


| OED (N=64) 


All Other 
Books (N=21) j 


\ Cannot Say 






Taper Much Greater 


ll6% 


24% 1 


|Paper Greater 


16% 


14% 


Taper Somewhat 
[Greater 


1 16% 


14% 


[No Difference 


W 


29% j| 


[Online Somewhat 
[Greater 


12% 


0% 


[Online Greater 


If 8% 


1 


[Online Much Greater 


16% 


14% I 



Note: Detail may not sum to 100% due to rounding. 



For The OED, 37 percent supported print books, 16 percent backed online books, and 31 
percent perceived no difference in work quality. For all other books, 52 percent voted for print 
books, 14 percent for online books, and 29 percent perceived no difference in quality. 

These responses are somewhat puzzling as the reference book most used online is The OED and 
the features of the CWeb version provide as much utility if not more than the print version (with 
the exception of being able to view neighboring entries at a glance). 

Cross-tabulation of these two questions finds considerable correlation in the responses - those 
who supported the paper version for productivity tended to support it for quality as well. 

Table 50. CWeb Online Survey: Quality and Productivity, September 1996 - June 1997 





Quality of Work 


f” ™ 

$ 

[Productivity i 

\ ; 


Cannot 

Say 


Better :i No Better j 

Paper :[ Difference!! Online ; 


[Cannot Say ■ 




[0 12 |0 j 


[Better Paper : 





|27 15 fl 1 


[No Difference 





W " Ip ' 1 


[Better Online: 





|9 115 ||l2 ! 



Almost a third of the 85 respondents ranked paper books as yielding both greater productivity 
and greater quality, while only one person ranked paper books better for productivity and online 
books better for quality. About 14 percent ranked online books better on both scores, while 
about ten percent ranked online books better for productivity but paper books better for quality. 



6.2.12 CWeb Online Survey: Columbia Cohort of Respondents 



The questionnaire asked a respondent to select one of several statuses offered as that which 
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represented his present primary relationship to Columbia University. The responses were 
distributed as follows. 

Table 51. CWeb Online Survey: Respondent's Columbia Status, September 1996 

June 1997 



. , . c . . 1 Number of 

Columbia Status : _ 

!j Responses \\ 


| % of | 

Responses! 


jUndergraduate i|49 


58% 


jGraduate Student ||20 


24% 


iFaculty i|6 


7% 


|Non-Faculty Officer i] 3 


4% 


! Staff 15 


6% 


| Special Student jl 


i% 


iOther Ijl 


i% ! 



Of the 85 respondents whose questionnaires were analyzed above, 58 percent were 
undergraduates and 24 percent graduate students. This is consistent with the server data on 
OED user status, which identified 58 percent of users and 55 percent of hits with 
undergraduates, and six percent of users and 1 1 percent of hits with graduate students. 



6.2.13 CWeb Online Survey: Discipline of Respondents 

The questionnaire asked a respondent to select one of 16 disciplines (including Other ) as that 
which defined his scholarly focus. The 85 responses were distributed as follows. 

Table 52. CWeb Online Survey: Respondent's Discipline, September 1996 - June 1997 



1 Number of 
iDiscipline = ^ ! 

r i{ Responses | 


] 

Responses ij 


iUndetermined '144 1 

? -} : i 


152% Hi 


j Architecture jl | 


1% i 


iArt !I3 I 

? : } : 1 


4% j 


I Business \2 j 


E% 1 


iComputer :L | 

| Science ij 


11% ; j 


'(Engineering ;|4 ;j 


|5% | 


j Health Sciences ! 6 ij 


fi% | 


fHistory \2 


|2% 1 


iHumanities |14 


16% 3 
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As the table shows, as might be expected, many of the undergraduate respondents have not yet 
selected a discipline. There were no representatives of seven possible disciplines, including 
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major ones such as Social Work, Social Sciences, and Natural and Physical Sciences, in the 
responses. 



6.2.14 Online Survey: Place in Project 

We will need to explore the responses to this survey closely now and as we track it in the future 
and utilize our findings in structuring the interviews we undertake in the months ahead. It would 
be surprising if we do not see a shift in responses as our collection grows and as users have an 
opportunity for continuing use. Of course, we may have difficulty eliciting repeat responses to 
our questionnaire from the same individuals. However, perhaps some repeat users who have not 
completed the questionnaire will do so in the future. If necessary, we will be more aggressive in 
seeking feedback from users, e.g., by sending them questionnaires or interview requests in email 
or by telephone. 

We are exploring various methods to increase our response rate. From March 15 to May 31, 
1997, there were 42 hits on the survey button; 14 on the OED survey and 28 on the monograph 
survey. In this period, 280 people used the online book collection; thus, only 15 percent of them 
went to the survey during any of their sessions with the collection. During this period, 22 
completed surveys were submitted, for a 52 percent return on surveys viewed. We are hopeful 
that introducing a frames design to our books, with the survey button on the frame along with 
navigational and search buttons, will remind users about the survey and encourage them to go 
to it and complete it. Clearly, getting that initial interest is critical to getting users to assist with 
our research by completing the questionnaire. 

Other options we are exploring include breaking up the online questionnaire so that users 
confront only a screen full of questions (i.e., each respondent would answer only a subset of our 
questions), however, the non-response problem is one of getting the users of the online books to 
click on the questionnaire button much more than one of getting them to complete the 
questionnaire once they have done that. We are exploring changing our incentives, such as by 
instituting an improved lottery, but changes to date have not had a notable impact. 



6.3 User Comments 

We are gathering more contextual feedback from users through follow-up questions on email 
and through personal interviews. We have been using this feedback in making design decisions 
and we will be pulling it together more systematically over the course of this semester and early 
next summer. 

Comments on questionnaires help us keep grounded in our work. The following example, 
quoted in full, shows remarkable insight into the complexities of assessing impact in a rapidly 
changing environment. It was anonymous. 

Exhibit 6. An Extended Comment 
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I Your questions show a decided bias that attempts to lead the technology-shy into giving a negative 
\review. You already know that this is a better method of text distribution! Why is this survey even 
\here? There are only 2 advantages that books could possibly have over online texts. 1. They are 
\easier to read. That issue will shortly become moot as people simply become accustomed to reading 
\the texts on a screen rather than on a page. 2. They are portable. Online sources are infinitely more 
j portable in an abstract sense since they can be distributed swiftly all over the world. Physically, 

{ every computer terminal is a potential source. It won't necessitate everyone getting a laptop to 
\make e-texts as portable as physical books, although that is happening. In sum, get with it! What 
\the [expletive deleted] are you doing? You KNOW that even if people aren't using this resource 
fervently now, they will in 2-3 years! Get off your butts and start putting more texts online instead 
\of writing inane, technophobic, leading polls. 



Other, more courteous responses call attention to the need for excellent search and browsing 
capabilities in online books. Some were praising the current design for its provision of these 
capabilities. Others were suggesting that better capabilities were needed. Users would 
particularly like to see more analytical tools in the CWeb OED. Analysis of these comments 
along with those made in the ongoing interviewing of users will come in the next stage of our 

reporting. 
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7.1 Access to Networked Computer 

As noted earlier (see section 4.2), in all of the Project's surveys the following question is asked: 
Is there a computer (in the library or elsewhere ) attached to the campus network (directly or by 
modem ) that you can use whenever you want? Our hypothesis is that the easier a Columbia 
scholar's access to the campus network and materials on CNet and CWeb the more likely he is 
to adopt online resources, including the collection of online books. In addition, we want to track 
this measure over time to see how it changes. The responses to this question in the in-class and 
CWeb online surveys are summarized here. 

An overwhelming majority (80 or 94 percent) of the 85 respondents to the CWeb online survey 
responded to this question in the affirmative. 

The students responding to the in-class survey did not see themselves as having such easy 
access to a networked computer. Of the 239 who responded to this question, 68 percent 
answered in the affirmative. The percent responding in the affirmative for the different types of 
classes was: 

Table 53. In-Class Surveys: Ready Access to Networked Computer: Whole Sample 

Spring 1997 



[Class Type 


N 


% 

Responding 

Yes 


! Contemporary Civilization 


102 


1” 82% : 


[Graduate Political Science 







[Undergraduate Political 
[Science 


12 


75% 


[Social Work Masters 
[Students 


104 


65% 

L ................ j 


[Total Respondents 


239 


68% : 



As in the on-site library survey, undergraduates claim greater access to networked computers 
than masters students do. 

Table 54. In-Class Survey: Preferred Method of Reading This Assignment and Access to 
Networked Computer: Whole Sample Spring 1997 



0 

ERIC 



2 oi / 



QO 

t~j CJ 



12/1/97 1:36 PM 



AKL’s Scholarly Communication and t echnology Project 



http://www.arl.org/scomm/scat/summertield7.html 



jPreferred Method of 

Reading Assignment 

:i JL 


Access to 
Networked 
Computer? 




Yes 1 


No 1 


\ 


(N=62) |j 


1 (N=23) j 


ijOwn Copy ij 


66% : 


| 61% j 


ilFriend's Copy jj 


6% || 


1 9% | 


IjLibrary Copy !j 


6% : 


4% | 


jPhotocopy 


6% j 


j 13% | 


^Reading it directly from 
jjCWeb l| 


11% : 


0% 


iiJAKE printout of text 


8% ; 


1 4% 1 


iPrintout using non-JAKE ij 
jjprinter 


5% || 


9% | 


iiDownload of online text || 






jito disk & reading away 
ifrom CWeb 


2% j 


0% | 



As the above table shows, comparing students' perceived access to networked computers and 
their preferred book form reveals that such access does not lead students to preferring online 
books. Given the stated reasons for their preferences, this is logical. Over 66 percent of those 
responding Yes to this question preferred their own copy of a book while only 61 percent of 
those responding No did. Photocopy was the preferred form for 13 percent of those responding 
No, but for only six percent of those responding Yes. This combination of responses suggests 
that an economic element is at work here. Those who cannot afford their own computers may 
also prefer not to buy books for classes. 



7.2 Time In Online Activities 

Based on study of the data, we have settled on collection of information on the amount of time 
spent per week in various online activities to represent the behavior of the users. (This question 
was discussed earlier in the context of the on-site survey of library users.) The balance among 
the various online activities will vary with discipline, and with the position of the user. In the 
versions of the questionnaire in use since last spring for books in print and online format, the 
data have been gathered by the following question. 



jAbout how many hours per week do you spend in each of the following online activities? 
Email: Listservs & Newsgroups: CLIO-Plus: 

.i ; 

Text/Image/Numeric Data Sources on WWW: Other WWW: 
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Since these activities are all measured in hours per week, we can sum them to produce a single 
simple measure of the level of online activity (as we asked the question in the on-site library 
user survey). The results are instructive. We have prepared tables showing the percent 
distribution of respondents by number of hours spent online, in all activities, for three different 
groups: users of online books, users of the OED in paper format, and students surveyed in class. 
(Table 5 gives equivalent data for the respondents to the March 1997 onsite survey of library 
users.) 



7.2.1 Responses to CWeb Online Survey 

As the following table shows, for the 80 users of online books, the mean is 14.8 hours spent 
online per week and the median is ten hours per week online. The greatest number of hours 
online reported was 71. 

Table 55. CWeb Online Survey: Weekly Hours In Online Activities, September 1996 - 

June 1997 



| Hours/Week in 
| Online Activities 


Number of | 
Respondents 


% of j| 

Respondent^ 


(Less than 2 


2 


2% 


(2-4 ZZ 


11 


14% :| 


P-6 


F 1 


;9% 1 


16-8 


In | 


1 14% 1| 


]8-10 


[To 1 


|l2% | 


jlO-12 


no 


1 12% ! 


fl2-14~ 


FFTIj 


|4% | 


(More than 14 


|26 | 


(32% || 



Breaking down the sample into those who claimed easy access to a networked computer (94%) 
and those who did not, gives means of 15 and 12.3 weekly hours online, respectively. This is 
not significant because of the small sample size. 



7.2.2 Responses to Questionnaire with Paper OED 

As the following table shows, for users of the paper format, online activity is lower with a mean 
of just 3.9 hours. 

Table 56. Weekly Hours In Online Activities for 11 Respondents to Paper Questionnaire 
on Use of OED, 1996 - Percent of Respondents 
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j Hours/Week In 
ijOnline Activities 


% of ;{ 

Respondents 


|l-2 


136% 


P : 4 I ~ ZjI 


136% j| 


|(4-6 


9% | 


[6-8 1 


9% ;| 


^Extremes (Max. :! 
M7) 


9 % i! 

L._ ij 


(Mean 


3.9 i| 



This set of findings on time in online activities by type of resource being used supports a 
hypothesis that users of online books will be people who spend significantly more hours per 
week in online activities than do users of the paper versions. As we reported earlier, onsite 
library users reporting on their use of online resources in the average week in Winter 1997 had a 
mean of 5.8 hours. 



7.2.3 Responses to In-Class Questionnaire, Fall 1996 and Spring 1997 

The in-class questionnaire also asked about weekly hours in online activities. (See Exhibit 4.) 
Responses were distributed as follows. 

Table 57. In-Class Surveys: Weekly Hours In Online Activities: Whole Sample Fall 1996 

and Spring 1997 



j Hours/Week 


Fall 1996 
(N=398)i 


Spring I 
1997 

(N=217) i 


[1-2 S 


26%' || 


34% 1 


|2-4 1 


30% || 


27% ! 


|4^~7ZI Ij 


19% 


13% ' 


[6-8 j 


8% 


10% 


[8-10 


5% j! 


3% 


110-12 


4% || 


3% 


|12- 14 


1% 


3% 


j Extremes 


8% i| 


|6% 


|Mean 


5.2 


[5.3 


! Maximum Hours j 


95 


|50 



Breaking this group down by type of class, we find: 

Table 58. In-Class Surveys: Mean Weekly Hours In Online Activities By Class Type: Fall 

1996 and Spring 1997 
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Class Type 


| Fall 1996 


[Spring 1997' 




f N 


jMean 


1 N~ 


jMean i 


1 Contemporary 
Civilization 


1281 


|5.1 


1 104 

,ii 


1 ( 5.8 


i | Political Science 


1161 






W3 1 


jSocial Work 


156 


16IZ 


il97 


Pu> 



The differences among these groups of students and between the two semesters are not 
statistically significant. 

Breaking the Spring 1997 responses down by their reported access to networked computers 
gives the following table: 

Table 59. In-Class Surveys: Weekly Hours In Online Activities By Access to Networked 

Computer: Spring 1997 



\ Easy Access to 
| Networked Computer? 





Yes 


No 


jHours/Week 


[ (N=154) 


:i ;j 

1 (N=55) [| 


} 1-2 1 


|27% 


153% | 


|2-4 “ ]| 


[28% 


[|24% | 


14-6 | 


jl6% 


||7% ] 


|6-8 || 


1 14% 


Jo% 


I8-10 ;j 


;3% 


||6% i 


1 10-12 


3% 


|6% I 


! 12-14 


[4% 


|o% ;| 


iMore than 14 


17% 


Il6% || 



jNote: Detail may not sum to 100% due to 
1 rounding. 



Students claiming easy access to a networked computer spend more time online than those who 
do not feel that they have easy access. About 31 percent of the former group spend at least six 
hours a week online while only 18 percent of the latter group do. 



In summary, the students surveyed in class have slightly greater uses of online activities than the 
users of the paper OED, surveyed in the library, but about 10 percent less than library users 
overall in March 1996 and 1997. Students with easy access to a computer are even greater users 
of online resources. Together these findings suggest that we are at the beginning edge of the 
transition to electronic use, and makes us confident that we will be able to map out the complete 
change in attitudes and behavior as availability and accessibility of online books changes the 
environment at Columbia University. 
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One of the more interesting issues to be tracked over the span of this project is whether the 
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center of gravity of user behavior shifts. That is, will we find in two years that the light users of 
online services are spending more hours per week online than are the average users of today. 
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We find ourselves at the beginning of a complex project, which we have planned in considerable 
detail. We are not as far along as we would have hoped, principally because it is much more 
difficult to bring books into online form than everyone has anticipated. In addition, the explosive 
growth of Web browser technology creates continuous pressure to improve the functionality of 
the books that go online. We are in the position of surgeons who must keep a patient active, 
while making drastic changes to that patient's anatomy. We believe that our procedures for 
surveying the users and analyzing their responses will help us to do that. We hope, in addition, 
that the results will prove useful to others who wish to understand or to replicate the transitions 
being pioneered at Columbia. 

We look forward to suggestions and comments from others who are approaching this problem 
from other perspectives. 

Appendix 1. Contemporary Books In the Online Collection 



Publisher/Title 


Author 


[Subject 


| Print 
[Status [ 


[Month 

[Public 


[No. of 
[Chapt. [ 
i°r 

[Essays ; 


j No. Of 
j Pages 


[ Price - i 
! Hard 

| ($) i 


\ ; 

i Price - j 
Soft ($) 


| Columbia University Press || 


[Great Paleozoic 
[Crisis 


[Erwin 


[Earth 

[Science 


jcirculati 


\6/91 


ilO/c 


I 327 

1 


| 57.00 


[ 27.50 j 

i h 


[Seismosaurus: The 
1 Earth Shaker 


[Gillette 


[Earth 

[Science 


jcirculati 


i 10/96 


[11c 

[ • 


| 205 


| 39.95 


I 


[Invasions of the 
[Land 


[Gordon 


[Earth 

[Science 


jjcirculati 


(6/97 

ng 


r 

! 10c 


| 312 


| 65.00 


j 17.50 | 


| Folding of Viscous 
[Layers* 


[Johnson 


[Earth 

i 

[Science 


jCirculati 




j 461 


\ 


[Dinosaur Tracks 
[and Other Fossil 
[Footprints* 


[Lockley 


[Earth 

[Science 


| 

jcirculati 


ng 


| 

j 338 

1 






[ Sedimento graphica : 
[Photographic Atlas 


[Ricci-Lu 


[Earth 
! Science 


|circulati 


jl/97 


8c 


j 255 


| 45.00 . 




[Development of 

[Biological 

[Systematics* 


[Stevens 


i Earth 

i 

[Science 


jCirculati 


ng 


r“~ 

j 616 





[Consuming 

[Subjects* 


Kowalesl^^^^Circulating 


j 185 


| 39.50 


| 15.50 


[Jordan's Inter-Arab: 
[Relations 


Brand r *! at ^Reserves! 3/97 

ilRelationsj :i 


■ l : 

:5 : 


| 350 


j 45.00 : 


[Managing 

[Indonesia 


Bresnan;^ nt f rna,: ^Reserves 3/97 
:.|Relationsj : | 


[10c 

I 


| 375 

I 


1 55.00 


i 

[ 19.50 

\ 


X \ 

X : 

[Logic of Anarchy* [ 

•i 


^ Hlnternat'liL 

Buzan , . Reserves 

!i Relations 




j 267 
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IHemmed In: [j j| T J 

(Responses ,o {CaUagy 

(Africa s... jj ;j 


[Reserves 3/97 [13e 


573 ( 


52.50 [ 


| 1 

1 19 - 50 Ij 


[China’s Road to the!-,. [[Internat'K 

Korean War* It™ (Relations 


Circulating 


1 339 


37.50 [ 


17.50 j 


[Culture of National ;,., _ jlnternat'I 

Security- I Katzens ‘fRelations 


Reserves 


| 562 [ 

j : 


50.00 


1 17.50 l| 

l (| 


[International i 

[Relations Theory Ii , [Intemat'I 

[& the End of the [ e ° W [Relations 
(Cold War* | j| 


Circulating 

j : | 


j ■ 

2925 j 

t ; 

i j 


ii ; 

j| ! 

45.00 1 17.50 |[ 

ii J 


IThe Cold War on iL. .. , [Intemat'I 
(the Penphery* jj ^Relations 


Circulating 


1 431 ( 


34.50 (| 17.50 J 


[Losing Control: [L ([Intemat'I 

(Sovereignty...* Ij assen ((Relations 


Circulating 


[ ; 

I 149 I 


24.95 j | 


[Gender In [| T . .„[ 

(International IITickner IL 

, . (Relations 

(Relations ;; :j 


I* ese Hil/96 L 

iCirculatUig 


| 180 1 


if ij 

30.00 i 15.50 (j 

J! I| 


IThe Inhuman (U (Literary ( 

[Race* | CaSSU “[Criticism 


Circulating 


! 289 1 

t j 

.. ........ ...J 


49.50 i 17.50 I 

:;( :j 


[Rethinking Class: [L. , ([Literary I 

[Literary Studies...*;! im0C [iCriticismj 


Circulating 

j | | 


1 285 i 


49.50 | 16.50 l| 


(The Blue-Eyed j„ ([Literary [j 

[Tarokaja* [1 eene ijCriticismj 


[Circulating 

I ; 


i i 

j 210 j | 24.50 [j 


(Ecological Literary;!^ , [Literary [ 
[Criticism* “Criticism! 


[Circulating 


I 185 1 


49.50 


[ 16.50 |j 


[Parables of ij M . ([Literary 1 

[Possibihty* [| n ([Criticism 


[Circulating 


j 263 [ 


27.50 


1 

\ 

\ 

\ 


(The Text and the [L _ „. [Literary (j 
l. . iPortelh (( v • '! 

(Voice* iCnticism 


[Circulating 


! 415 i 

1 


1 


[At Emerson's IL [[literary [ 

(Tomb* [I C [Criticism 


[Circulating 


| 320 


49.50 || 16.50 [j 


[Extraordinary II |L . [j 

[Bodies: Figuring iiThomsoiiu . . ■ y 
[Physical...* || |^nucism 


[Circulating 


| 

| 200 | 


45.00 (j 16.50 J 

i i 

\ 


jwhat Else But If Y7 || 

(Love? The Ordeal Ii' WeimteiL, 1 .f. rar ^ 

( ._, . ;i (Criticism 

•iof Race...* •• ■{ 


[Circulating 


| 237 1 


42.00 : j 15.50 j 

i j 

:t ij 


[Columbia jj || [ 

[Granger's Index to |[Granger|[Poetry [ 
(Poetry II [[ 


D$k | 10/94 N/A j 

i . , . :i : 


] 231 j 




| 


lOzone Discourses IILiftin jP^tical ^ 

( ij j: Science ;; 


[Reserved 1/97 16c 

i i 1 1 ; 


1 257 i 




j 16.50 j 

\ 
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$ 

[Concise Columbia 1 

■: : 

| Electronic 
i Encyclopedia 


j 

Referenc< 

j 


1(3/91 |N/A 

!. es .. 1 j| 1 


| 943 


j 49.95 jj 


jHierarchy Theory* jjAhl 


Science 


[Circulating 


( 206 


__ | 


jRefiguring Life: jj 

j Metaphors of 20th | Keller j 
j Century Biology* jj 


: 

j 

Science 


[Circulating 


j 134 

t 


20.00 j 16.50 j 

!| j 


•The Molecular i;„ riv 

U. ! • * 1! Williams 

iBiology of Gaia* :j 


: 

Science 


i : j 

[Circulating 


| 210 


45.00 j j 


j Sampling the jj Sm j 

i Green World* jj eSSy j 


Science/ j 
Botany j 


[Circulating 


289 j 


49.50 i | 

| 


|The Illusion of Li . i 

: T * iiCelam ; 

liLOVe* :: 


Social 

Work : 

: 


j ~1 j 

[Circulating 


217 


27.50 j 16.50 | 


j Mutual Aid | Ij 

[Groups, Vulnerable!-,. [Social 

jPopulations, & the ; Gl,terma fwork j 
jLife Cycle ji ji 


i s i i 

Reserved 1 1/96 =2 le i 

: ■: : f j 

1 II II 1 


448 j 


39.50 j ! 

i | 


1 Supervision in i|^ , 

ISocial Work | Kadustaf 


Social 
‘Work j 


Reservesj9/96 jj 10c jj 


597 | 


45.00 j | 


j Eating Disorders: iC. 
iNew Directions* jj ° y jj 


Social 
Work 1 

: : j 


Circulating 

: i 

: : i 


166 


42.50 1 15.00 

ii ij 


[From Father's ij 

[Property to jjMason jj 

[Children's Rights* jj 


j j| 

Social jj 

(Work ij 

1 ji 


l ; I 

j i j 

[Circulating j 


237 


40.00 j 16.00 !| 

;[ j 

1 ! 


[Handbook of 

'■i :: :: 

j Gerontological [Monk 

[Services jj jj 


[Social jj 
Work 


j - r ,v : | 

[Reserves9/96 j[25e j 


694 


65.00 


[Turning Promises ll XT 
.Into Performance I Na,h “ 1 


[Social jj 
[Work jj 


Circulatii9/96 j 13c [j 


160 j 


45.00 j 15.50 j 


[Philosophical 

[Foundations of jjReamer jj 

ISocial Work 


Social jj 
Work jj 


[Reserve^ /ft , :L ji 

Circulating^ ] 5c jj 


219 


i ^ 

i 

49.50 ij 17.00 j 


[Task Strategies: ij 

jAn Empirical jjReid 

[Approach jj jj 


[Social jj 
[Work jj 


Reserves9/96 [lie J 

!.. . ij... i! 


329 


37.50 ; ; 


("' " " jj jj 

[Experiencing HIV*jj Sears 


[Social jj 
[Work jj 


[Circulating j 

1 j 1 


182 


ij 

45.00 | 15.00 jj 


[Qualitative jj 

[Research In Social ilShermanj 
[Work J 1 


[Social [j 

Work j 

1 


i :: ' f < 

j :j :i j 

[Reserves! 1/97 [43e j! 

i :j j 

: 


520 


i 

ji 

57.50 | 27.50 j 

\ if 


[The Empowerment!! 
[Tradition in jj Simon jj 

j America* jj 


[Social jj 

Work 

1 : 


[Circulating j 


297 | 


49.00 | 22.50 [| 



| Garland Publishing 
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<NaUve American ^ i 

L„ iBataille ■ 

[Women i; 


Biograph 


iReferendl/97 

( ii i 


N/A 


| 333 




1 


1 African American iL . 

i: Salem • 

;Women n 

j ■* • 


B iograph|Referend 1/97 

II li 


N/A 


| 622 [ 




j 

j 


jChaucer Name ide [English | 

[Dictionary liWeever [[Literature 


[Reference 12/96 


N/A 

l j 


f | 

1 451 i 

i 






[ Oxford University Press 












| 


[Oxford English 
[Dictionary 


Language 


\ ii 

[Referend9/96 

► : i 


|n/a 

\ * 

} : 


| N/A j 

1. I 




| 


[Postcards from the [i 
[Trenches: [j 

j Negotiating the ; 

[Space Between := 

[Modernism & The [j 
[First World War** j 


Literary j 
Criticism 


r ! 

t 

1 i 

[Circulating 

5 : 

\ ; 




| i 

| i 

i 186 | 

1 i 


35.00 


1 

! 

1 

J 


[The Erotics of ;l„ . 

Talk- « Kaplan : 

f. :: :j 


Literary 

Criticism 


[Circulating 

j : 




| 240? j 


35.00 i 


1 16.95 j| 


P'Littery Man": L 

j Mark Twain... J Lowrey j 


Literary 

Criticism 


t ;♦ : 

[Circulatii 11/96 


\4c 


i 177 | 

1 T i 


39.95 


! 

| 


[Children's [j 

[Literature & IjMay 

[Critical Theory jj i| 


Literary 

Criticism 


[Circulatiil 


|9c 


\ | 

1 243 

\ 


29.95 j 


| ii 

1 18.95 i 

1 1 


[ :! '\ 

[Poetics of Fascism ;|Morrisor[ 

{ i: 


Literary 

Criticism 


[Circulatii 10/96 


|4c 


| 177 | 


39.95 : | 

i: 


[Novel & || [j 

[Globalization of [Moses ij 
[Culture [j ij 


Literary 

Criticism 


[Circulatiil 1/96 


\4c 

> : 


| 240 i 


! 18.95 ij 

1. 1 


[Modernism & the ij 
[Theater of [Parkes | 

[Censorship ij 


Literary [j 
Criticism 


|Circulatij6/97 


Uc 

f j 


| 242 1 


45.00 | 


j 

\ 


[Romances of the || || 

[Republic: Women, ij 
[the Family, & [j [I 

[Violence in the ijSamuelsii 

j: : : : I 

[Literature of the jj ij 

[Early American [| 

[Nation** [i | 


Literary [ 
Criticism 


[Circulating 




| 208 

I 


39.95 


[ 

| 


[Majestic Indolence: j [[ 

[English Romantic |Spiegelnq 
[Poetry... II II 


[Literary I 
[Criticism 


[ Circulatii 1/97 


\ j 

!6c 


I 221 | 


49.95 




[[Making Mortal || 

[Choices: Three iL , 

u • • n* , ilBedau ii 

[Exercises in Moral n 

[Casuistry** ij i| 


PhilosopI 

i | 

| | 


^Circulating 

i ] 


| 123 ! 


29.95 


\ 

j ! 

1 1 3 - 95 i 

! ' 
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| Morality, 
[Normativity & 
[Society 


Copp 


Philosopl 


iCirculati 


} 10/97 


1 10c 

j 




| 262 


; 

42.00 [ | 


[Free Public 
[Reason: Making It 1 
jUp ... 


ji j 

D ' AgostiiPhilosop 1 


j : 

iCirculati 

i 


10/96 


1 i 

; 10c 


| 203 j 


45.00 ; | 


Metaphilosophy 
land Free Will** 


Double 


Philosopl 

: 


[Circulating 


| 192? 


'$ 

35.00 : | 


[Bangs, Crunches, 
[Whimpers & 
[Shrieks 


Earman | 


Philosopl 


iCirculati 


10/96 


f 1 

\ ; 


1 257 

1 


35.00 ; | 


[Causation and 
[Persistence: A 
[Theory of 
[Causation** 


ihring 


Philosopl 


iCirculati 


ng 


| 191 I 

l 


39.95 | 


[Self Expression: 
[Mind, Morals & 
[Meaning... 


FlanagahPhilosopl 

ii 


iCirculati 


10/96 [ 


1 12c 


| 222 j 

1 


24.95 ; | 


[Logic of Reliable ; 
[Inquiry 


Kelly 


: 

Philosopl 


iCirculati 


! 10/96 j 


1 16c 


I 434 

{ 


59.00 1 | 

I | 


[Philosophy of 
[Mathematics & 
[Mathematical 
[Practice In the 17th 
[Century 


Mancosii Philosopl 

[j | 


ICirculati 


10/96 ; 


I 6c 

< : 


| 275 


: \ 

60.00 | 

[ { 


[Moral Dilemmas &| 
[Moral Theory** 


mason ij 


[Philosopl 


^Circulating 


j 

1 246 

s 


45.00 1 

; \ 


[Autonomous 
[Agents: From Self I 
[Control to 
[Autonomy 


Vlele 


Philosopl 

: 

| i 


ICirculati 


10/96 ; 


1 13c 

i : 

f : 

5 ; 


| 371 

! 


49.95 | 


[Other Minds: 
[Critical Essays 


'lag el 


( : 

Philosopl 


iCirculati 


10/96 | 


|22e 

\ : 


| 229 


26.00 | 


The Last Word** 


Nagel 


[PhilosoplfCirculating 




| 147 


19.95 ; | 


[Law & Truth 


^ttersopPhilosoplfCirculatiU 1/96 


|7c ] 


j 189 


39.95 ! 


[Nietzsche's System 1 


Richards: 


c ' 1 

iPhilosopHCirculati 


i 10/96 


[4c 


r 316 


35.00 | 


[Freedom & Moral [ 

[Sentiment 

.} • 


lussel 


[Philosopl 


iCirculati 


il0/96 


1 12c 

i ’■ 


| 200 


45.00 : | 


[Living High and 
[Letting Die** 


Unger || 


[Philosopl 

> i 


Jcirculati 


ng 


j 187 


39.95 | 14.95 ]| 


[The Human 
[Animal** 


Weston | 


i* - 

[Philosopl 


Inot in 

[yet I 


j 208? 


29.95 ; | 


[Real Rights 


Wellman; PhilosopljCirculatil 1 0/96 


j8c 


| 279 


52.00 : j 


| Simon & Schuster ij 



o 

ERIC 



1G4 



12/1/97 1:37 PM 



AKL's Scholarly Communication and Technology Project 



http://www.arl.org/scomm/scat/summertielcl8.htmi 



[Bond Markets**# 

1 Marketing 
[Management**# 


Fabozzi [[BusinessffReserves j 595 

Kotler [[BusinessffReserves j 824 

\ j \ 


72.00 | 

75.00 ; | 


[Statistics for 
[Business & 
[Economics** 


NewboldBusinessifReserves j 895 


61.50 ; | 


[Investments** 


Sharpe [[BusinessijReserves j 900 


80.00 | 


[Financial Market 
[Rates & Flows** [[ 


[X 311 j Business ^Reserves | 338 

;Homc \\ ]\ § 


41.00 | 


[[Politics & the 
[Media 


[Davis ; [ P°Uti ca l ;fp eserves j4/97 jy c fjj 432 

ijScience if :f if 


30.00 ; j 


[Public Policy 
[Analysis** 


[Dunn [|^ olitical [[Reserves ! 480 




[International 

[Politics 


Holsti ^ olilical 1 Reserve^ 1/97 i 15c i) 432 

\\ Science :f ; ; if if 


32.25 | | 



[Notes: * Permission has been received, but the book is not yet online. ** Book 
[is not yet online. 

if 

\# A new edition has been issued for which we need the electronic file. 



Appendix 2. Format Availability, Winter 1997, and Introduction Date 



: | 

: \ 

[ Unix : 

[w/Patty 

: f : 


CNet-fj CNet i| CWeb . ;! 

~ „ „ iCWebw/; 

Own if w/Lynx f w/Lynx f .. 

brmat/itext-baseqltext-based^^^^ f 

Patty if browser * browser j 


if Columbia Concise 
i! Electronic 
Encyclopedia. 


3/91 [ 1 


\Oxford English if 

if Dictionary 


8/94 i | 9/96 i| 


9/96 i| 


[Granger's Index to j j )Q/94 j , Q/94 

if Poetry j i 


10/94 | 


pxaucerName [ 12/96 ;| 12/96 

i Dictionary \ : \ 


! 12/96 ;! 


^Native American \ ~ IC .~ 1/0 - 

TTT Z/ 9 / 1 Izsl 

• Women 


1/97 j 


\African American 1 A/A - 

1 Women | 2/97 1 2/97 1 


2/97 ij 


i! All other books [1995-199 1. 


[1995-1997 



• Unix access allows the user to simple type in a command (e.g., OED) at the Unix prompt 

and to go to the resource from there. The Patty 2.0 interface and search engine allows 
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sophisticated searching. In the Unix mode the user can save a whole entry to a file. 

• ColumbiaNet ( CNet) is a gopher-based Campus Wide Information System (CWIS). Users 
can dip individual screens (which may not encompass a whole entry) and download (file 
transfer), mail or print them. Some Web documents have been linked to CNet menus via 
lynx, the text-based Web browser. The user then has both lynx and CNet functionality. 

• ColumbiaWeb (CWeb) is Columbia's main World Wide Web site. LibraryWeb (LWeb) is 
the Libraries' site within CWeb. Both can be accessed by either a graphical browser or 
lynx. All graphical browser functionalities are available to the community while using the 
online books - reading, finding words, printing pages or whole documents, saving to a 
file, copying and pasting to a word processor document. A lynx user can save an entire 
Web file to a local file, email it or print it to the screen. Or she can copy and paste 
portions of a Web file to another document. 



Appendix 3. Home Computers: Minimum Specifications Recommended 
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., [s/94 (for 

Spec,ficat,o (stu[|ent) 


jl2/94 


|4/95 


8/95 


1 11/95 


.. .... 








[75 Mhz 


! 




1 


75 Mhz 


j Pentium 


CPU I486 

; 


1486/66 


|486DX2/66 


Pentium 


i (slowest i| 

| Pentium 
| available) 


RAM j4MB 


]8 MB 




8 MB 


[8 MB :[ 


Drive jlOO MB 

^EpO-Clty 


|340 MB 


|500 MB 

I 


750 MB 


|lGB 


CD-ROM j 
Drive 


jDouble 


jDouble 

\ 


Quad 


jj i 

jQuad 


VIonitor: 




15" 




j 15” j 


Slze (SVGA- 




|256-color 

jSVGA 


17" better 


Capacity | compa,ible 






j72-Hz 


Graphics: ij 

Pixels 1 




|640 x 480 


65,000 


| || 

|640 x 480 j| 

1 i| 


. ISVGA 






1256 

| 


Colors :| 

: 

i 




1256 

'< 


MB 


|l MB 

1... 1 


Video RAMI 












1 


Sound 




Sound: 






|16-bit 


Card 




1 16-bit Sounc 
jBlaster-comp 


Blaster 

comp. 

iuuid 


i SB-compatible 

? :f 

1 ij 


Speakers 




! 


Stereo 


IPowered 

1 ;j: 


Modem 




il4.4 kbps 
jfax modem 


14.4 kbps 


\ 14.4 kbps 
ax modem j 


Price :|$1,500 


$2,500 


|$l,800-$2,00 


(Not Given 


lAbout 

1$2,000 


|| 








| "Multimedia j 


| 






i Walter S. 


jFamily PCs: } 
INcw ;j 

| Minimum ;j 






| "Family 


iMossberg, 

\Personal 


jFamily PC, 

Source 15/1/94, 

jp. 140+ 


|pc 

iMagazine 


jShopper 

ISmartcard," 

iFamlly PC, 

4/95 


i Technology , i 

IWall Street 
ijoumal, 

18/31/95, p. 

|bi 


1 System 

1 Requirements," 
|& "Family ij 
jShoppcr 
ISmartcard,” ij 


I 






iFamilyPC, ij 
11/17/95 
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|Specificatioii4/96 


4/96 


5/96 


111/96 


[4/97 J 


[CPU 


75 Mhz 
Pentium 

: 


133 Mhz 
Pentium 


120 Mhz 
Pentium 


U33Mhz 

i Pentium 
|(200 Mhz is I 
[fastest 
[available) 


1 166 Mhz | 

Immx II 

j :i 

[Pentium 
[(200 Mhz if | 
[possible) 


(ram 


8 MB 

: 


16 MB 


16 MB 


[16 MB EDO 
[RAM 


1 1 6 MB (32 ]| 
[preferable) [j 


| ! 

[Hard Drive j 

[Capacity 

\ I 


1 GB 

: 

1 


Fast 1.2 GB 


1.2 GB 


jl.2 GB 


[2.0 GB, ;l 

[more if 
[possible 


i 

[CD-ROM | 
[Drive 

\ i 


: 

Quad 


Quad 


Quad 


[6X (up to 
|12X 

[available) 


\ if 

8X II 

1 ij 


F~ H 

[Monitor: 

[Size 


15" 

72-Hz 


15" (17" 
)etter) 


17" 


ii5" 


17" with i 

[maximum [| 
[.28 mm dot [j 
[pitch 


[Graphics: 

[Pixels 

1 1 

[Colors II 

(Video RAM] 


640 x 480 j 
256 
1 MB 


64 bit 

Graphics 

Accelerator 


65,000 
1 MB 


[Accelerated 

[PCI 

[graphics 
[card w/1 

|mb RAM 


! 2 MB 

[VRAM l| 

I 


[Sound: Card [ 
[ Speakers 


16-bit 

SB-compatibl 

Powered 


Not 

mentioned 


16-bit 

SB-compatib 


1 16-bit FM 
[music 
Isynthesis, 
i SB-compatib 


\ 

le 


[Modem 

5 


14.4 kbps 
fax modem [ 


28.8 kbps 

data/fax 

modem 


28.8 kbps 


[28.8 kbps 


133.5 kbps, || 
[upgrade to [j 
[56 kbps 


L [Pair USB II 

.Connectors 1 I: 

{ sports |j 


[Price l| 


About 

$2,000 


$2,500 or 


$2,000-$2,5( 


($2,000 


f i[ 

[Not given 


^Source 


"Family 
Shopper 
Smartcard," [ 

Family PC, 
April 1996 


Bill Howard, 
'At Home," 

PC 

Magazine, 

4/23/96, p. ; 
300. Min. 

For "Perfect 

Borne 

Computer" 


Walter S. 
Mossberg, 
Personal 
Technology, 

Wall Street 
Journal, 

5/10/96, p. 
B1 


•"The '97 
| Multimedia 
[Family PC, 

[Family PC, 

[Dec. 1996 
[(reed 

ill/19/96), ; 

|p. 68. 


1 

[Walter S. | 
[Mossberg, ij 
{Personal 
[Technology, [ 

[Wall Street [ 
[journal, 

[4/9/97, p. 

|bi 1 
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Appendix 4. Gateway 2000 Home Computers: System Specifications 



iSpecificatior|12/94 


4/95 


5/95 jj 


12/95 (™jl 


4/96 


1 

[Computer 

[Name 

1 


P5-60 

Family PC j 
(featured in j 
ads) 


P5-60 
Family PC 
(featured in [j 
ads) 


P5-75 i| 

Family PC 
(featured in [] 
ads) | 


P5-100 [| 

Family PC 1 
(Top Rated, J 
BestBuy) ij 


P5-150 


|cpu 


60 Mhz 
Pentium 


60 Mhz 
Pentium 


75 Mhz | 

Pentium 


TOO Mhz [j 

Pentium ij 


lJOMhz j 
Pentium ( 


|ram 


8 MB 


8 MB 


8 MB 


8 MB [| 


16 MB j 


[Hard Drive 
Capacity 


• 

540 MB 

: 


540 MB 


730 MB 


1 GB j 


1.6 GB 


ICD-ROM 

jDrive 


2x 


4x 


4x 


4x i! 

i ii 


6x 


[Monitor: 

[Size 


14" 


15" 


17" i 


1 

15" [1 


17" [j 


[Graphics: 

1 Pixels 

: 

[Colors 
[Video RAM 


I 

1 MB 


1 MB 


2 MB 


! ; 

j 

: 

1 

2 MB j 


|2MB 

| : jj 


[Sound: Card 
[Speakers 


1 16-bit ii 16-bit |16-bit [16-bit 1 16-bit | 

SB-compatibiSB-compatibiSB-compatib|SB-compatibl(;SB-compatib 

;i j ■ | 

[Altec [[Altec [Altec ; | Altec Lansing! Altec 

[Lansing [[Lansing [Lansing [ACS-40 (Lansing 


[Modem 


i 14. 4 kbps 
[fax modem ii 


14.4 kbps 
[fax modem 


|14.4kbps 
[faxmodem [i 


28.8 kbps fax |28. 8 kbps 
imodem [|fax modem J 


[Software 

[Included 


MS Works +1 
CD-ROMs 1 


MS Works + 
CD-ROMs 


IMS Works + 
ICD-ROMs i 


MS Works, i| 
120 

iCD-ROMs j 


IMS Office J 

195 ii 

; \\ 


[Price (+ 
[shipping) 


j$2,099 


$2,099 


($2,499 


$2,149 


$2,899 

! i 


[Source 


! i 

|GW2000 ad |i 


{ i 

[GW2000 ad 

| 


(GW2000 ad 


["Multimedia [j 
[Family PCs: ii 
iRecommende( 
[Systems," 
[Family PC, 
111/17/95 & ii 
[GW2000 
[advertising 
[insert, 12/95 ii 


j > 

i \ 

GW2000 ad ! 

i 

i 

i 

j 

[j 
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[Specificatior 


5/96 


5/96 


■i I1C/Q7 Sr 11 :i 

10/96 [10/96 “ [5/97 


[Computer 

[Name 


P5-133 
Family PC | 

; : i 


P5-120 
Family PC [j 


P5-166 ;(G6-180 U7ZZ7I I 

Family PC [Family PC IG5-200M [| 

... j • i /r j • ; (featured in L • 

(featured inffeatured inr, . : (modified) !i 

ads) [ads) [| adS) :j |j 


[CPU 


133 Mhz 
Pentium 


120 Mhz || 
Pentium 

j 


— [2()0 Mhz | 

I 66 Mhz 1 Pentium ImMX [MMX |j 

Pentlum [Pro | Pentium [Pentium | 


[RAM 


16 MB 

5 :i 


Ij 

: 

16 MB 

ii 


[32 MB/256 1 16 MB/25 6 [l 6 MB/5 1 2 1 

16 MB/256 [KB ||KB |KB 

KB Cache [internal [Internal [Internal 

[Cache ICaehe [Cache 


[Hard Drive [ 
[Capacity 


1 1.62 GB j 


850 MB || 


2 GB :2 GB i 1.6 GB ! 1.6 GB 

I. ii !i ii. ii 


[CD-ROM [ 
[Drive 


|8x | 


ij 

8x ij 


8x ]8x ] 12X 1 12X | 


[Monitor: 

[Size 


j 17 " ;| 

jVivitron [j 


[15" [17" [17" [ 15" [|1 5" [| 

[CrystalScanjCrystalScanjVivitron ICrystalScanlCrystalScanj 


[Graphics 
[Video RAM 


64 Bit PCI [|64 Bit PCI j| 
|AcceleratonAccelerator[ 
jw/MPEG [jw/MPEG j 

[Video [[Video [| 

| Scaler [Scaler 

1 i 1! 

[2 MB Ijl MB 


|64 Bit PCI [64 Bit PCI | 

164 Bit PCI [64 Bit PCI [Graphics [Graphics [[ 

[Graphics [Graphics ii \ ii 

ij |3-D [3-D | 

[2 MB l[2MB j 

i| i|2 MB i!2 MB 

Lr — .-rr^rrrr^ 






| Sound: Card 
[Speakers 



1 16-bit 
[SB-compati 



[Altec 

[Lansing 

ACS-40 



i Modem 



| Software 
included 



28.8 kbps 
fax modem 



16-bit 



16-bit 
[Gateway 



116-bit 



SB-compatiiSound, 

ilSB-comp. 



[Ensoniq 

iWavetable 



1 16-bit !16-bit 
[Gateway [Gateway 
[[Sound, SB [Sound, SB 



jcomp. 



[comp. 



Altec 

Lansing 

ACS-40 



[[Altec 

[Lansing 

[ACS-40 



[Altec 
[Lansing 
i ACS-40 



[Altec 

[Lansing 

lACS-41 



[Altec 

[Lansing 



[ACS-41 



[28.8 kbps 
fax modem;! 



; | [j [Telepath [Telepath [I 

[[36.3 kbps [36.3 kbps [[modem [modem 
[[fax modem [fax modem [Iw/speakerpfw/speakerphone, 
|[w/speakerpfw/speakerptx2 Tech [|x2 Tech [[ 
ij [upgradeable upgradeable 



|| [[MS Office 

ij [i [I97 

MS Works MS Works :U .. U ,. 1 ’ , 

. . 1 . ;;GenerationsGenerationsEncarta, 

+ 14 + 14 :* i TT ilxiTXirv 

. ill ill [MMX :97 

CD-ROMs CD-ROMs i :{ ij— , , ^ , < , 

1 ::Tech-Enhanced 



IMS Office 



[[Software 



12 OJ ID 



110 



12/1/97 1:37 PM 



AKL’s Scholarly Communication and Technology Project 



Http ://www .arl.org/scomm/scat/summertield8.btml 



Price (+ 
jshipping) 


| 

[$2,549 ($1,999 


($2,199 $2,649 

i .11 


15/97: 

|$ 1,799 
16/97: 

1$ 1,749 


1 $2,064 


i Source 


[GW2000 IGW2000 

[ad, 5/96 |ad, 5/96 


IGW2000 l|GW2o6o 
lad, 10/96 lad, 10/96 


(gW2000 

lads 


|GW2000 1 

1 website 



Appendix 5. U.S. Household PC & Internet Penetration 
(ALL PERCENTAGES ) 



0 

ERIC 

1 n hinimiaiBHiiaiiii 

13 oi id 



iYear & Source (so) for Estimate 





1 2000 


so 


199so j 


|HH 


l 




“in 


:jPenetratip5 


8 


oo 

r- 


jPCs 






i i 



\ja% 

97 



}.SO 



Ml 




Share of Primary 
HHPCs: 



Pentium 
486 "j 

Windows-based 
PCs 
(Share 
of All 
HH 
PCs) 

HH 

Penetrati|50 
Modems: | 



42 



Dei: 

-P<f 



139 



18 



' \Jaif iSefi 

f° 1.96 s0 li -Pi' 



|37!!9 



I i( t t 

135 1 1 135 \9 



Jut? 

so 



|35J 


K 


| j! 


r™ 



32 



11 



[wjioj 




13412 

)32.|6 



50!|1 



|24j2 



42.|6 




u 



;|32 



\Jati -\Sep 
\-95 194 



[31 11 ;35 



;SO 



33|2 



1 7 13 14 12 

BoiiFI 






|l8jl 
i 20 1 3 



14 



|7312*; 

kife "1 



Met 

-94 

31 



so 



50 



12 
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iHH | 






















jPene trader. ij 
i Online ij 


8 il 


r- 

(N 


8 i 


Ii7ji 


1 ;jl7;| 


4 1 


14:|5 : 


11 : 1,4] 6.4 


9 9 I 1 i 4.5|9 |5 


3 i 


| Services | 








s 


| \ 

! 3 i! 




| ; ;j 


|| 1 


MUM 1 il :! ;! 

[ ;i f j \ A :[ il 














11! 


;8 


[ipEI 


j 46 2** 


[l2j|3 jj25|2*i 





Ihh 


j 


i Penetration 


1 ; l i 


j of Other; 


(26 12** 


i Internet i 


I i| ; 


i Access 


S \\... / 


(Adults 




i : \ :( : 


i(>=age j 


! 1 


i ! Mi ! 


|16) ! 


l~ 2 i 


P ! h 1 ! 2 i 


(using 


! : 

; j 


I : 1 1 ; 


i Internet ; 




! 1 | i : 


Ihh ] 


| ( 


IPenetration 


boh ; 


iCD-ROMs 


1 1 



S83T* 



r-“ ■: r " \ 

155112*: 



'[NOTES: 

I* Percentage of new computers purchased in previous year. 

(** Percentage of modem owners subscribing to an online service. 



■ 

il. Odyssey Ventures. Jared Sandberg, "PC Makers' Push Into More Homes 
(May Be Faltering," Wall Street Journal, March 6, 1997 

(2. Software Pubhshers Association Surveys (Telephone survey, about 500 
(adults) 

(3. Times Mirror Surveys (Telephone survey, about 3,600 adults) 

(4. Electronic Information Report, 1996 Online Subscriber Survey 

(5. PC-Meter, Use of Internet Access Service in Last Month, reported by 
(Reuters in clari-news 

(6. NPD Group, Inc., http://www.npd.com/met.erpr4.htm . "Latest NPD Survey 
(Finds World Wide Web Access From Homes Grew Fourfold in Second Half of 
11995" Report on survey of sample of 44,800 homes. 

|7. Nielsen Media Research survey for CommerceNet, Juba Angwin, "Internet 
iUsage Doubles in a Year, San Francisco Chronicle, March 13, 1997 

j 8. Jupiter Communications, 

( http://www.jup.com/Jupiter/release/jan97/consumer.shtml . January 6, 1997 
["New Devices and Technologies Will Drive Net Into 36 Million Homes by 
1 2000 " 

(9. INTECO Corp., htt p://www.inteco.com/pu96 1 03 1 .html . "Percent of HH 
iwith PCs, Internet Access: 1993 to 1996 
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jlO. PC-Meter, "Pentium, Windows 95 in Minority of Home Installs, According 
jto New PC Meter Reports," July 1, 1997 Press Release from PC-Meter. PC 
|Meter panel consists of 10,000 PC-owning households in the U.S. Note: Value 
[given as share of 486 processors is actually all sub-Pentium PC processors, so 
[includes 286s and 386s as well. Report also notes that 47 percent of household 
[PCs now have Windows 95. 



Appendix 6. Concise Columbia Electronic Encyclopedia Sessions, 1994 - 1997: CNet 





Number of Sessions 


% Change: [j 


if"™' 

, :i 

[Month !] 


i 

1994 


| 1995 


| 1996 


J 1997 || 


•94to 
! ’95 : 


f *95 to 1 
1 ’96 il 


'96 to ) 
’97 ij 


pan. 


1,186 


1993 

.:? 


[645 


1224 


-16% ij 


[-35% | 


-77% ; 


[[Feb. 


[1,645 


II 1,342 


[991 


1341 


[-18% || 


1-26% ij- 


-66% j 


i[Mar. 


1,529 


ill, 508 


1997 


1394 


-1% 


i-34% | 


-60% j 


H April 


[r,55i“~ 


77,335 


1896 


1250 1 


-14% ij 


[-33% I- 


-72% [| 


[[May i 


1,042 ' 


]|757 


’[{458 


|l97 I 


-27% 1 


[-39% 1 


-57%"j 


lJune 


[713 


1466 


1326 




-35% [ 


[-30%:] 


| 


Ny 


712 


11775 


1(412 




-33% 1 


|-13% i 


| 


|Aug : ! 


708 


|496 


1251 






-30% 1 

: ; ; 


[-49% 1 


i 


iiSept. 


1,160 


!|761 


1291 




1-34% !| 


[-62% [ 


■: 

| 


ilOct. 


7579™ 


17257" 


1542 






1-57%"'"; 


| 


INov. 


[7,596 ' 


][7029~ 


1405™ 




U36% ij 


[6i%n 


| 


[Dec. 


7,300 


1(833 


1 300 




[36% 


U64%T1 


| 


[Total 1 


15,021 |l724i6[6[5lT I 


-25 % 


-42%""; 





I j Note: July 1995 hits are estimated. 
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at Emory University 
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Session #4 Patterns of Usage 
Online Books at Columbia: 

Measurement and Early Results on Use, Satisfaction, and Effect 
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and 

Mary C. Summerfield 
Coordinator, Online Books Project 
Columbia University Libraries 

and 

Paul Kantor 
Consultant 
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The book could be used entirely in an online format or the scholar could choose to acquire a 
print version of all or part of the book once he had browsed the online version. Alternatively, at 
least at some point in time and for some forms of books, such as textbooks, an electronic format 
such as a CD-ROM might be better - for technical, cost or market reasons - than either the 
online or the print format. Malcolm Getz addressed some of the format issues well in his paper 
at this conference, Electronic Publishing in Academia: An Economic Perspective. 



2 - In effect, funds that would have been spent on interlibrary loan activities, i.e., staff and mailing 
costs, would be redirected to the producers of the scholarly knowledge, thus supporting the 
production and dissemination of such scholarship. 



Detailed background information is provided in the Project's Analytical Principles and 
Design document of December 1995 and in its Annual Report of February 1997. Both are 
available at http://www.columbia.edu/dlc/oIb/ . 



4 - Ultimately, if online books were to become a regular product of scholarly publishers, the 
publishers would make the online version a regular output of their production process. This 
reengineering might or might not lead to a reduction in publishers' production costs, but it 
would certainly mean that universities would not be faced with the conversion of printers' tapes 
to HTML. 



5 - Software allowing annotation of an electronic document is available, but few people are 
aware of it. The Project will seek to bring such software to the Columbia community as feasible. 



6 . 



A few reference books were already online. Their design will be discussed shortly. 



7 - The SGML mark-up of these texts as provided was inconsistent. A conversion which was 
expected to be done quickly and nearly automatically was instead a labor intensive, time 
consuming process, resulting in the delayed provision of the texts on the Web. 



8 - Publishers, including Chadwyck-Healey and Oxford, have provided permission for such 
conversion. 



9 - Greater detail is available in the Annual Report. See Appendix 1 for a summary of the online 
collection with titles, subject matter and location within the Libraries collections of the print 
copies (reference, regular circulating collection, reserves collection). 
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10 - Until recently contracts with authors contained no provision for electronic versions of books. 
Current contracts include such provisions, but royalties are specified as a percentage of 
revenues derived from sales in electronic format. As there is no price for the materials included 
in this research effort, the Press needs to obtain permissions for this special use. 

Our agreement with Garland requires them to provide HTML-coded files as we do not have 
funding to undertake conversion for additional publishers. Thus, Garland must assess its 
manpower and funding availability in determining the books it will provide. 



12 - One Oxford file is awaiting conversion. 



Two of these books, designed for course use, have gone into new editions since we received 
the electronic files, so we need to obtain the files for the latest editions before putting these two 
books online. 



^ See the Annual Report on the Project’s Web home page for greater detail. 

15 - So far the Project Coordinator has conducted telephone interviews with three authors who 
refused permission and inquired about their reasons for doing so. Columbia University Press 
received explanatory comments from several other authors when they refused permission. 



16 - Recommendations from satisfied users to their colleagues is always one of the key sources of 
sampling for new products. However, it is one over which we have least control. 



17 - By early Summer 1997, the online Reserves catalog will contain entries for the online 
versions of books that have been put on reserve for various courses. This should increase usage 
by students in courses for which a book is assigned reading. 

18- A repeat user of the collection could bookmark any of the pages and return to it with just 
one step. 



The OED, Granger's Index to Poetry, Chaucer Name Dictionary, African American 
Women, and Native American Women. 



20 - Consistent with marketing theory, the TULIP project found that usage of online journals was 
much greater at institutions that had conducted substantial campaigns to build awareness and 
trial. See Elsevier Science, TULIP Final Report, 1996, for details. 
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21 • As noted earlier, this document is included on the Web page for the Project. Questionnaires 
and other research methodologies have been fine-tuned after pretests and early use, but the 
general concepts remain in place. 



22 - Networked printing that allows such tracking is not yet in place. 



23 - The chart does not have value labels, so these are estimates of the values. 



24, Source: Amy Cortese, "A Census in Cyberspace," Business Week Online News Flash, 
April 24, 1997 



25, Data are taken from a fact sheet issued by Columbia's Academic Information Systems in 
February 1997. 



26 • A question about access to a Web browser has just been added to Project questionnaires. 



22 • In a Spring 1997 interview, a second year social work graduate student who lives in New 
Jersey said that she has a modem in her home computer but does not use it as direct dialup to 
Columbia is a long distance call and at $20 a month an ISP account is too expensive. She 
thought that about half her classmates might not use the Internet from home even if they had 
computers. 



28, For the following tables, Web data prior to May 1966 include hits by Project staff, those 
from May 1966 forward do not. These were excluded as they can be substantial in number as 
resources are in design phases and do not reflect the scholarly use that we are studying. The 
earlier statistics cannot be refined to extract such hits. NA: data are not available; NC: total or 
change is not calculable. 



29 • Analyzing server data is proving more difficult than anticipated as user identification is 
instituted. In the future, data will be reported on a monthly basis and reports will be issued 
quarterly. 



30, This is the common opinion of users who have completed questionnaires and others who 
were interviewed by email and in person. 
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this single work. 



32 - These are host computers with addresses linking them to the dormitory network. See section 
4.3. 1.2. 



33 • Their questionnaires have not been removed since we started tracking these books in 
January 1997. 



34, A larger collection is available on CD-ROM in the Electronic Text Service. We could not 
obtain permission to put some of these online. 



35, This type of skewed distribution, or Bradford law, is typical of all types of library collections. 



3 ° - Gitterman's Mutual Aid Groups was on reserve for three professors for Fall 1996 semester, 
but we could not put it in the collection accessible to the Columbia community until November 
due to delays in obtaining permission from the authors. It was in use in three Social Work 
classes for Spring 1997 semester. 



37, Community members can request that a book be recalled but that process is not guaranteed 
to bring the book back to the library and it can take several weeks. Online books are always 
accessible for such browsing. 



3 ^' This impression was confirmed in a recent interview with a second year social work student. 
She noted that her home computer has a modem but that she does not have a ISP account or 
dial-in to Columbia from her home in New Jersey (a long distance call) because of the cost. All 
of her use of online resources occurs on campus, in the Social Work computer lab or in a 
library. 



39, Hitherto, IP addresses were the basis of controlling access to the books. The new 
authorization system was put into effect for The OED at the first of April 1997. One means of 
accessing The OED, via a bookmark, is necessarily not included, so The OED's use is still 
understated. It is not yet in place for Granger's Index to Poetry so that resource is not included 
in this analysis. 



40 - We are in the process of obtaining permission from institutions affiliated with Columbia to 
use the directory information about their users for our research. As a result, we do not have 
cohort detail on 40 (14%) of the users. Percentages given are with that set of 'unidentified users' 
as a separate group. 
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41 • We have removed Officers of the Libraries and specific other individuals who are involved in 
the Project from these data. 

42 - For use data to show revealed preference, the collection must contain books that would 
draw users to the collection repeatedly - either books that users want to look at repeatedly or an 
assortment of books that pulls scholars to the collection for a variety of purposes. 

43 - The Past Masters texts used in the second semester of the course are studied at the 
beginning of the semester making it difficult to make arrangements with the instructors on time. 



44- JAKE is the networked laser printer system maintained by AcIS. Undergraduates and Social 
Work students have a free 100 page quota for JAKE printing each week. 



45 - The two Garland reference books are not separated out, even though different uses are 
offered on their questionnaires. 



46, Two changes were instituted in the middle of the Spring semester - a snappier line requesting 
completion of the survey and a change to a $20 gift certificate from a $20 copycard. 



47, All textual documents available on CWeb can be accessed via any graphical interface or via 
lynx. Lynx can be used at the University's Unix prompt with the command lynx 
http.VAvww. Columbia, edu/. / 



’ % ■*>: *:• «S; ' i%: *■: & % %. 
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For additional information about the conference, or The Andrew W. Mellon Foundation 's scholarly 
communication initiatives, please contact Richard Ekman . For additional information about ARL or this 
web site contact Patricia Brennan . ARL Program Officer at (202) 296-2296. 



Return to O ffice of S cho la r l y Commu n ication H o me Pa ge 



O 

ERIC 






12 o 



12/1/97 1:41 PM 



AKL’s Scholarly Communication and Technology Project 



http://www.arl .org/scomm/scatysummertield .tn.html 




ARL Home 



ARL Scholarly Communication and Technology Home Page 



© Association of Research Libraries, Washington, DC 
Web Design by An gelo F. Cruz. 

Maintained by ARL Web Administrator 
Last Modified: September 8, 1997 




121 



12/1/97 1:41 PM 




U.S. Department of Education 

0ffica of Educational Research and Improvement (OERI) 
Educational Resources Information Center (ERIC) 

'<|||§P / REPRODUCTION RELEASE 

(Specific Document) 

1. DOCUMENT IDENTIFICATION: 




ERIC 




Title: 

Scholarly Communication and Technology 


Author(s): online documents located at http://www.arl.cni.orq/scomm/scat/index. 


Corporate Source: \ 

The Andrew W. Mellon Foundation 1 

{ 


Publication Date: 
April 1997 


II. REPRODUCTION RELEASE: 



html 



In order to disseminate as widely as possible timely and significant materials of interest to the educational community, documents announced 
in the monthly abstract journal of the ERIC system, Resources in Education (RIE), are usually made available to users in microfiche, reproduced 
paper copy, and electronic/opticaJ media, and sold through the ERIC Document Reproduction Service (EDRS) or other ERIC vendors. Credit is 
given to the source of each document, and, if reproduction release is granted, one of the following notices is affixed to the document 



If permission is granted to reproduce and disseminate the identified document please CHECK ONE of the following two options and sign at 
the bottom of the page. 




Check here 
For Level 1 Release: 

Permitting reproduction in 
microfiche (4" x 6" film) or 
other ERIC archival media 
(e.g., electronic or optical) 
and paper copy. 



The sample sticker shown below will be The sample sticker shown below will be 
affixed to all Level 1 documents affixed to all Level 2 documents 



PERMISSION TO REPRODUCE AND 




PERMISSION TO REPRODUCE AND 


DISSEMINATE THIS MATERIAL 




DISSEMINATE THIS 


HAS BEEN GRANTED BY 




MATERIAL IN OTHER THAN PAPER 






COPY HAS BEEN GRANTED BY 


\0 


• * - 


' \z 


J' 

cP 






J 




X? 


TO THE EDUCATIONAL RESOURCES 




TO THE EDUCATIONAL RESOURCES 


INFORMATION CENTER (ERIC) 




INFORMATION CENTER (ERIC) 




Check here 
For Level 2 Release: 

Permitting reproduction in 
microfiche (4" x 6" film) or 
other ERIC archival media 
(e.g., electronic or optical), 
but not in paper copy. 



* Level 1 



Level 2 



Documents will be processed as indicated provided reproduction quality permits. If permission 
to reproduce is granted, but neither box is checked, documents will be processed at Level 1. 



Sign 

here-* 

please 



ERIC 



’thereby grant to the Educational Resources Information Center (ERIC) nonexclusive permission to reproduce and disseminate 
this document as indicated above. Reproduction from the ERIC microfiche or electronic/optical media by persons other than 
ERIC employees and its system contractors requires permission from the copyright holder. Exception is made for non-profit 
reproduction by libraries and other service agencies to satisfy information needs of educators in response to discrete inquiries, m 


Signature: L — ^ 


Printed Name/Position/Title: 




C ) fj/J v 


Richard Ekman, 


Secretary 


Org ^'(zation/A caress : " V 

The Andrew W. Mellon Foundation 


Tefepfione: 1 

212-838-8400 j 


TaX" 

1 212-223-2778 


140 East 62nd Street 
New York, NY 10021 


W-MaifAddressr 

re@mellon.org | 

\ 


1 Date: 

11-24-97 



(over) 



